-- Logs begin at Tue 2022-10-18 10:53:42 UTC, end at Tue 2022-10-18 12:00:58 UTC. -- Oct 18 11:31:25.791254 dv-cinder-815582-17-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 18 11:31:25.798906 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 18 11:31:25.804987 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 18 11:31:25 2022] *** Oct 18 11:31:25.804987 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 18 11:31:25.804987 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 18 11:31:25.804987 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: nodename: dv-cinder-815582-17-iscsi Oct 18 11:31:25.804987 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: machine: x86_64 Oct 18 11:31:25.804987 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: clock source: unix Oct 18 11:31:25.804987 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: pcre jit disabled Oct 18 11:31:25.804987 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: detected number of CPU cores: 4 Oct 18 11:31:25.804987 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: current working directory: / Oct 18 11:31:25.804987 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: detected binary path: /usr/bin/uwsgi-core Oct 18 11:31:25.804987 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: your processes number limit is 47680 Oct 18 11:31:25.804987 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: your memory page size is 4096 bytes Oct 18 11:31:25.804987 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: detected max file descriptor number: 2048 Oct 18 11:31:25.804987 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: lock engine: pthread robust mutexes Oct 18 11:31:25.804987 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: thunder lock: enabled Oct 18 11:31:25.804987 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 18 11:31:25.804987 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 18 11:31:25.842585 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: Python main interpreter initialized at 0x55ed338a99c0 Oct 18 11:31:25.842585 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: python threads support enabled Oct 18 11:31:25.842585 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: your server socket listen backlog is limited to 100 connections Oct 18 11:31:25.842585 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: your mercy for graceful operations on workers is 90 seconds Oct 18 11:31:25.843144 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: mapped 403077 bytes (393 KB) for 2 cores Oct 18 11:31:25.843144 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: *** Operational MODE: preforking *** Oct 18 11:31:25.843361 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: *** uWSGI is running in multiple interpreter mode *** Oct 18 11:31:25.843361 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: spawned uWSGI master process (pid: 110434) Oct 18 11:31:25.843563 dv-cinder-815582-17-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 18 11:31:25.844599 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: spawned uWSGI worker 1 (pid: 110435, cores: 1) Oct 18 11:31:25.844599 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: spawned uWSGI worker 2 (pid: 110436, cores: 1) Oct 18 11:31:25.844599 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 18 11:31:26.527053 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 18 11:31:26.591855 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 18 11:31:27.634569 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 11:31:27.634569 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: from cryptography.utils import int_from_bytes Oct 18 11:31:27.635249 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 11:31:27.635249 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: from cryptography.utils import int_from_bytes Oct 18 11:31:27.796380 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 11:31:27.796380 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: from cryptography.utils import int_from_bytes Oct 18 11:31:27.797333 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 11:31:27.797333 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: from cryptography.utils import int_from_bytes Oct 18 11:31:30.208785 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 18 11:31:30.209626 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 18 11:31:30.209626 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 18 11:31:30.209907 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 18 11:31:30.210152 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 18 11:31:30.210534 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.210856 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.211173 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.211488 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.211815 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.212131 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.212441 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.212753 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.213125 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.213383 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.213692 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.214011 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-17-iscsi {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.214329 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.214633 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.214939 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.215255 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.215563 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.215877 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.216184 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.216681 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.217143 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.217449 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.217757 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.218093 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.218610 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.218790 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.218997 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.219303 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.219623 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.219931 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.220332 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-17-iscsi {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.220643 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.220977 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.221241 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 18 11:31:30.222546 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.222771 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 18 11:31:30.222915 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.222915 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.223262 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 18 11:31:30.223402 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.223402 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.223643 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 18 11:31:30.223787 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.223949 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.224085 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 18 11:31:30.224286 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.224434 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.224575 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.224721 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.225058 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.225258 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.225398 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.225593 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.225808 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.225966 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.226124 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.226273 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.226529 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.226737 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.226883 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.227047 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.227206 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.227345 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.227483 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.227654 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.227924 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.228086 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.228275 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.228435 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.228575 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.228775 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.228983 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.229144 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.229355 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.229530 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.229682 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.229832 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-17-iscsi {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.229973 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.230188 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.230336 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.230538 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.230683 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.230834 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.231061 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.231214 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.231421 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.231580 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.231987 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.232187 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.232330 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.232578 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.232731 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.232930 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.233082 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.233272 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.233514 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.233766 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.233956 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.234149 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.234297 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.234441 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.234630 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.234779 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.235058 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.235236 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.235405 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.235729 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.235886 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.236033 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.236179 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.236310 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.236444 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.236591 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.236832 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.237128 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.237342 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.237481 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.237632 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.237812 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.237955 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.238110 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.238247 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.238400 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.238630 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.238785 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-17-iscsi {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.238922 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.239218 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.239359 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.239546 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.239697 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.239852 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.240085 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.240243 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.240395 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.240673 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.240823 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.241050 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.241194 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.241332 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.241572 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.241737 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.241883 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.242034 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.242173 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.242438 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.242595 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.242744 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.242900 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.243033 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.243319 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.243469 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.243613 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.243788 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.243948 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.244205 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.244357 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.244615 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.244773 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.244968 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.245124 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.245262 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.245396 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.245582 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.245743 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.245980 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.246173 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.246328 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.246532 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.246701 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.246854 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.247067 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.247235 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.247441 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.247667 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.247891 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.248146 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.248402 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.248402 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.248783 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.248955 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.249116 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.249262 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.249262 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.249531 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.249719 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.249869 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.250008 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.250156 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.250302 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.250438 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.250572 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.250710 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.250907 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.251059 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.251197 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.251418 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.251564 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.251801 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.251955 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.252213 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.252349 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.252484 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.252714 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.252895 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.253039 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.253201 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.253370 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.253639 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.253793 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.254022 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.254177 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.254329 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.254475 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.254650 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.254902 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.255045 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.255278 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.255418 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.255586 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.255832 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.255977 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.256200 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.256355 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.256493 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.256739 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.256929 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.257083 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.257248 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.257405 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.257703 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.257852 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.258025 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.258173 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.258326 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.258539 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.258703 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.258929 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.259079 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.259226 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.259451 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.259597 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.259839 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.260012 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.260156 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.260387 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.260557 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.260765 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.260945 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.261134 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.261287 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.261423 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.261692 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.261856 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.262053 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.262209 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.262364 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.262571 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.262728 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.262939 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.263353 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.263557 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.263732 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.263923 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.263923 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.264183 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.264331 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.264469 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.264618 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.264772 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.265016 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.265163 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.265303 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.265443 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.265662 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.265824 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.265955 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.266359 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.266511 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.266649 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.266812 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.266963 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.267140 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.267287 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.267492 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.267633 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.267816 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.268034 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.268709 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.268957 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.269148 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.269305 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.269568 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.269723 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.269873 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.270160 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.270317 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.270465 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.270707 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.270863 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.271041 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.271248 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.271408 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.271677 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.271843 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.271991 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.272245 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.272400 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.272586 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.272786 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.272988 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.273248 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.273400 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.273558 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.273829 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.274007 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.274152 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.274372 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.274530 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.274717 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.274909 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.275077 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.275328 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.275491 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.275636 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.276061 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.276234 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.276234 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.276519 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.276650 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.276794 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.277031 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.277185 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.277429 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.277616 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.277767 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.278020 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.278197 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.278387 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.278653 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.278817 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.278968 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.279128 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.279272 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.279417 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.279581 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.279824 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.279996 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.280148 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.280364 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.280526 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.280756 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.280978 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.281150 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.281371 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.281578 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.281727 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.281892 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.282052 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.282238 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.282387 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.282533 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.282782 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.282929 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.283107 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.283256 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.283398 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.283660 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.283833 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.284625 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.284884 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.285108 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.285263 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.285509 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.285681 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.285827 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.285994 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.286145 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.286389 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.286661 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.286823 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.286964 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.287109 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.287352 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.287502 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.287691 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.287842 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.288012 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.288283 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.288447 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.288632 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.288790 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.288957 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.289197 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.289364 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.289567 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.289719 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:31:30.289870 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.290179 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.290411 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.290544 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.290673 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.290828 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.291091 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.291229 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.291401 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.291617 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.291765 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.292018 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.292181 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.292337 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.292567 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.292720 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.292939 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.293109 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.293283 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.293527 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.293694 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.293917 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.294066 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.294223 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.294447 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.294665 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.294818 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.294986 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.295140 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.295355 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.295506 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.295709 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.295858 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.296000 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.296257 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.296410 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.296612 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.296802 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.297003 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.297244 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.297423 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.297575 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.297862 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.298024 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.298184 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.298406 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.298577 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.298756 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.298960 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.299114 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.299402 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.299568 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.299742 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.299999 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.300189 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.300339 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.300586 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.300908 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.301145 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.301362 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.301577 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.301796 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.302014 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.302014 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.302418 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.302627 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.302842 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.303055 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.303262 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.303490 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.303490 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.303891 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.304114 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.304323 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.304528 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.304775 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.304965 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.304965 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.305452 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.305678 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.305906 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.306116 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.306324 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.306531 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.306531 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.306880 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.307071 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.307260 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.307407 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.307553 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.307699 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.307699 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.308010 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.308149 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.308284 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.308428 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.308428 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.308696 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.308879 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.309028 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.309189 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.309189 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.309458 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.309618 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.309618 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.309890 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.310026 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.310172 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.310312 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.310312 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.310600 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.310742 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.310742 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.311029 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.311146 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.311307 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.311423 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.311423 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.311685 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.311818 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.311818 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.312076 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.312213 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.312432 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.312583 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.312728 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.313120 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.313278 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.313428 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.313570 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.313733 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.313934 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.314096 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.314240 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.314382 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.314518 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.314659 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.314798 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.315134 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.315443 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.315610 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.315781 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.315989 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.316135 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.316398 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.316540 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.316740 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.316987 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.317151 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.317446 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.317659 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.317887 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.318090 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.318323 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.318532 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.318737 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.318737 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.319133 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.319337 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.319548 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.319746 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.319945 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.320153 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.320385 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.320584 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.320584 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.320932 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.321059 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.321315 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.321519 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.321720 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.321922 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.321922 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.322299 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.322512 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.322710 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.322906 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.322906 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.323308 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.323518 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.323726 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.323938 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.324136 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.324337 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.324337 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.324726 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.324953 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.325157 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.325356 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.325556 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.325784 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.325784 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.326208 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.326412 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.326629 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.326833 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.327054 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.327273 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.327478 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.327684 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.327684 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.328070 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.328275 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.328493 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.328714 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.329025 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.329237 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.329237 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.329651 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.329850 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.330046 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.330242 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.330441 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.330645 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.330645 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.331593 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.331812 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.332007 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.332195 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.332401 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.332623 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.332623 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.333029 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.333227 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.333422 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.333617 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.333827 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.334023 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.334228 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.334471 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.334471 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.334870 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.335014 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.335274 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.335464 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.335464 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.335828 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.336032 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.336234 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.336441 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.336649 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.336879 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.337149 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.337395 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.337395 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.337834 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.338078 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.338304 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.338532 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.338817 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.339026 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.339026 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.339432 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.339640 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.339865 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.340081 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.340081 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.340456 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.340655 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.340951 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.341184 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.341390 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.341613 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.341613 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.341962 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.342161 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.342381 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.342587 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.342820 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.343029 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.343029 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.343029 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.343029 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.343029 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.344006 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.344215 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.344423 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.344643 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.344870 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.345082 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.345082 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.345500 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.345707 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.345945 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.346152 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.346152 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.347077 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.347288 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.347511 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.347717 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.347717 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.348086 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.348283 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.348497 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.348693 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.349019 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.349236 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.349236 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.349624 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.349837 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.350078 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.350286 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.350495 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.350699 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.350909 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.351113 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.351113 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.351534 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.351766 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.351978 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.352178 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.352387 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.352610 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.352610 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.353025 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.353173 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.353318 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.353458 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.353603 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.353736 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.353736 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.353997 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.354154 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.354299 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.354459 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.354459 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.354734 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.354881 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.355028 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.355185 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.355384 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.355532 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.355532 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.355793 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.355922 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.356060 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.356193 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.356351 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.356493 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.356493 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.357094 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.357247 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.357392 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.357529 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.357654 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.357773 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.357773 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.358033 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.358159 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.358279 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.358410 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.358410 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.358665 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.358806 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.358944 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.359064 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.359064 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.359266 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.359393 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.359393 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.359640 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.359788 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.359930 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.360068 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.360068 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.360312 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.360445 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.360581 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.360718 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.360718 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.361029 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.361174 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.361174 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.361438 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.361581 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.361735 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.361863 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.362038 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.362182 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.362182 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.362469 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.362634 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.362634 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.362910 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.363054 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.363196 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.363343 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.363343 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.363621 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.363761 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.363898 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.364098 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.364098 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.364402 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.364547 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.364547 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.364805 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.365032 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.365196 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.365333 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.365333 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.365659 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.365795 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.365940 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.366097 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.366097 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.366369 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.366550 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.366696 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.366839 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.366839 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.367119 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.367273 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.367419 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.367562 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.367562 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.367828 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.367968 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.368115 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.368257 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.368257 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.368522 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.368676 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.368819 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.369058 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.369058 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.369361 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.369550 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.369704 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.369859 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.369859 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.370121 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.370310 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.370310 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.370594 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.370732 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.370877 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.371021 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.371021 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.371328 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.371472 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.371630 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.371766 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.371766 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.372032 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.372166 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.372301 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.372443 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.372443 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.372707 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.372889 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.372889 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.373158 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.373296 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.373450 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.373582 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.373582 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.373848 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.373981 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.373981 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.374232 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.374377 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.374533 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.374677 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.374820 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.374964 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.375104 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.375338 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.375542 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.375687 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.375822 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.375974 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.376217 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.376385 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.376530 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.376751 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.376997 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.377138 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.377298 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.377607 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.377758 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.377914 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.378106 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.378245 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.378396 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.378593 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.378746 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.379005 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.379147 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.379310 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.379527 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.379708 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.379899 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.380244 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.380385 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.380546 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.380793 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.380968 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.381202 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.381344 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.381527 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.381806 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.381978 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.382184 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.382332 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.382492 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.382764 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.382910 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.383046 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.383305 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.383456 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.383676 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.383835 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.383966 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.384236 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.384381 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.384552 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.384687 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.384878 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.385179 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.385322 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.385482 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.385659 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.385789 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.386090 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.386184 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.386393 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.386542 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.386773 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.386934 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.387086 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.387282 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.387436 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.387579 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.387833 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.387981 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.388183 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.388326 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.388482 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.388720 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.388901 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.389143 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.389294 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.389453 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.389630 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.389766 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.390051 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.390268 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.390493 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.390756 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.390968 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.391183 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.391388 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.391388 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.391808 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.392031 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.392233 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.392439 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.392614 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.392775 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.392775 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.393117 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.393850 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.393992 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.394136 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.394136 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.394407 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.394562 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.394697 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.394843 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.395018 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.395170 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.395385 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.395529 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.395695 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.395982 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.396142 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.396285 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.396482 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.396643 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.396929 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.397068 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.397240 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.397462 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.397611 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.397845 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.397994 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.398172 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.398374 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.398536 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.398803 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.398978 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.399118 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.399250 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.399434 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.399676 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.399859 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.400026 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.400171 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.400328 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.400625 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.400836 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.401061 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.401202 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.401348 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.401596 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.401766 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.401911 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.402050 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.402193 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.402499 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.402648 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.402808 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.403045 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.403233 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.403389 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.403542 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.403688 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.403948 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.404110 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.404278 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.404420 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.404568 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.404957 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.405111 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.405257 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.405421 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.405566 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.405797 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.405979 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.406149 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.406323 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.406478 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.406796 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.406961 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.407271 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.407444 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.407617 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.407798 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.407959 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.408209 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.408375 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.408548 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.408823 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.409563 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.409750 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.409926 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.410377 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.410377 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.410667 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.410851 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.410993 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.411124 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.411255 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.411515 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.411790 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.411790 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.412178 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.412394 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.412609 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.412967 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.412967 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.413383 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.413383 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.413770 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.413975 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.414195 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.414195 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.414574 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.414777 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.414993 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.415217 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.415432 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.415633 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.415846 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.416053 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.416053 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.416447 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.416661 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.416892 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.417116 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.417321 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.417522 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.417522 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.417914 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.418127 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.418330 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.418546 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.418742 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.418955 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.419152 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.419362 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.419362 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.419759 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.419982 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.420203 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.420446 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.420652 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.420799 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.421002 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.421170 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.421170 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.421450 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.421619 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.421835 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.421999 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.422167 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.422307 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.422307 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.422555 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.422696 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.422696 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.423083 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.423235 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.423375 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.423512 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.423512 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.423775 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.423927 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.424073 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.424204 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.424204 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.424487 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.424641 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.424641 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.424944 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.425088 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.425230 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.425383 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.425383 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.425654 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.425798 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.425952 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.426073 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.426073 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.426341 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.426485 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.426485 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.426748 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.426890 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.427041 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.427192 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.427326 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.427462 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.427462 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.427717 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.427860 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.427996 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.428135 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.428413 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.428566 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.428707 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.428887 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.429029 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.429331 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.429493 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.429629 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.429772 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.430022 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.430160 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.430295 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.430661 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.430812 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.430949 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.431113 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.431253 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.431405 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.431637 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.431801 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.432037 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.432249 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.432456 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.432684 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.432935 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.432935 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.433308 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.433450 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.433595 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.433737 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.433876 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.434008 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.434166 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.434361 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.434501 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.434720 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.434890 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.435062 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.435325 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.435477 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.435621 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.435765 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.435911 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.436173 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.436393 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.436606 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.436821 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.437053 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.437273 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.437509 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.437728 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.437941 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.437941 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.438364 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.438697 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.438914 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.438914 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.439325 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.439537 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.439747 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.439967 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.440218 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.440430 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.440662 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.440662 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.441344 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.441572 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.441767 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.441959 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.442182 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.442372 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.442558 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.442761 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.442761 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.443126 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.443292 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.443437 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.443599 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.443599 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.443865 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.444004 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.444141 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.444280 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.444280 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.444559 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.444700 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.444835 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.444996 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.444996 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.445272 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.445398 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.445525 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.445667 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.445667 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.445942 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.446080 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.446080 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.446401 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.446536 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.446671 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.446896 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.446896 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.447169 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.447318 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.447318 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.447691 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.447849 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.447849 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.448129 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.448280 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.448451 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.448586 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.448739 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.449077 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.449230 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.449372 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.449513 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.449744 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.449900 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.450039 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.450247 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.450407 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.450620 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.450773 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.450954 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.451167 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.451338 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.451584 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.451746 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.451916 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.452198 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.452356 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.452521 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.452741 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.452950 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.453130 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.453346 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.453587 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.453736 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.453981 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.454140 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.454354 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.454510 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.454658 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.454893 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.455048 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.455248 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.455484 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.456163 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.456381 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.456535 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.456677 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.456959 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.457113 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.457333 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.457477 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.457616 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.457890 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.458057 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.458246 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.458388 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.458570 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.458790 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.458951 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.459185 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.459330 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.459511 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.459697 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.459850 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.460114 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.460263 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.460400 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.460628 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.460790 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.461038 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.461286 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.461474 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.461622 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.461770 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.461946 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.462104 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.462270 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.462535 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.462685 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.462870 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.463013 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.463192 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.463440 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.463640 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.463808 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.463952 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.464132 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.464479 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.464626 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.464766 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.465050 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.465279 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.465483 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.465701 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.465905 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.466109 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.466337 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.466555 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.466555 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.467017 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.467230 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 18 11:31:30.467431 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.467431 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.467809 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.468098 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.468470 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.468824 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.469244 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.469631 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.470013 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.470390 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.470772 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.471169 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.472216 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.472677 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.473092 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.473490 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.473944 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.474326 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.474724 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.475110 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.475489 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.475866 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.476250 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.476694 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.477107 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.477504 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.477911 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.478310 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.478702 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.479090 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.479475 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.479850 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.480216 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.480589 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.481007 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.481366 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.482049 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.482492 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.482915 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.483277 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.483636 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.484073 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.484440 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.484802 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.485192 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.485562 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.485918 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.486286 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.486679 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.487232 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.487606 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.487983 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.488396 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.488767 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.489209 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.489589 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.489984 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.490375 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.490755 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.491142 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.491526 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.491931 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.492467 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.492875 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.493289 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.493676 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.494146 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.494557 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.495203 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.495599 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.495981 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.496360 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.496778 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.497211 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.497596 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.497987 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.498371 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.498753 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.499137 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.499547 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.499947 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.500345 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.500763 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.501200 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.501590 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.501991 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.502381 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.502912 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.503345 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.503727 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.504120 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.504563 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.504978 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.505377 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.505744 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.506110 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.506474 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.506876 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.507242 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.507604 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.507974 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.508356 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.508745 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.509159 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.509527 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.509891 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.510259 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.510920 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.511304 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.511705 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.512105 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.512491 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.512991 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.513448 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.513842 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.514213 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.514649 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.515035 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.515412 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.515782 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.516166 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.516543 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.516997 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.517391 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.517775 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.518992 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.519408 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.519798 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.520194 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.520603 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.521048 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.521427 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.521822 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.522199 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.522572 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.523112 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.523490 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.523874 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.524248 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.524676 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.525121 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.525493 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.525878 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.526251 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.526643 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.527039 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.527421 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.527789 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.528181 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.528551 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.528989 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.529386 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.529759 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.530145 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.530521 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.530901 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.531282 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.531669 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.532088 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.532474 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.532904 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.533389 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.533905 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.534800 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.535231 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.535622 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.536024 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.536417 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.536804 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.537306 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.537696 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.538355 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.538754 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.539154 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.539562 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.539961 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.540340 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.540714 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.541144 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.541545 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.541927 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.542314 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.542695 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.543076 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.543537 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.544002 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.544406 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.544791 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.545269 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.545653 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.546036 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.546414 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.546795 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.547180 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.547665 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.548087 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.548482 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.548887 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.549318 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.550023 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.550412 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.550799 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.551186 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.551574 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.551969 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.552379 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.552773 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.553198 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.554152 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.554542 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.554938 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.555416 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.555808 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.556212 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.556613 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.557046 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.557482 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.557867 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.558270 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.558691 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.559088 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.559488 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.559866 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.560254 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.560630 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.561074 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.561469 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.561851 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.562230 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.562606 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.562990 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.563368 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.563868 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.564244 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.564677 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.565741 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.566185 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.566632 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.567080 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.567518 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.567924 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.568328 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.568738 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.569191 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.569597 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.570001 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.570405 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.570810 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.571254 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.571692 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.572113 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.572533 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.572984 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.573403 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.573811 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.574312 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.574755 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.575176 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.575584 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.576091 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.576515 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.576959 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.577373 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.577829 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.578245 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.578689 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.579127 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.579554 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.579959 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.580382 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.581454 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.581879 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.582363 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.582780 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.583208 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.583620 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.584039 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.584586 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.584996 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.585362 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.585733 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.586156 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.586525 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.586892 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.587307 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.587731 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.588109 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.588471 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.588883 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.589292 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.589717 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.590100 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.590522 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.590920 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.591306 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.591690 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.592069 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:31:30.592380 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 18 11:31:30.618435 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO dbcounter [None req-690b97c2-849f-496e-8782-682cbeb2f56f None None] Registered counter for database nova_api Oct 18 11:31:30.641613 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_db.sqlalchemy.engines [None req-690b97c2-849f-496e-8782-682cbeb2f56f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110436) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 11:31:30.649808 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writer thread running {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 11:31:30.711909 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.context [None req-690b97c2-849f-496e-8782-682cbeb2f56f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7aca09e1-1559-4e39-9509-e923bbe1e225(cell1) {{(pid=110436) load_cells /opt/stack/nova/nova/context.py:464}} Oct 18 11:31:30.716085 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-690b97c2-849f-496e-8782-682cbeb2f56f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:31:30.716837 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-690b97c2-849f-496e-8782-682cbeb2f56f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:31:30.718547 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-690b97c2-849f-496e-8782-682cbeb2f56f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:31:30.719598 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-690b97c2-849f-496e-8782-682cbeb2f56f None None] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:31:30.720203 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-690b97c2-849f-496e-8782-682cbeb2f56f None None] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:31:30.722644 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-690b97c2-849f-496e-8782-682cbeb2f56f None None] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:31:30.724907 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO dbcounter [None req-690b97c2-849f-496e-8782-682cbeb2f56f None None] Registered counter for database nova_cell0 Oct 18 11:31:30.729597 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO dbcounter [None req-690b97c2-849f-496e-8782-682cbeb2f56f None None] Registered counter for database nova_cell1 Oct 18 11:31:30.738885 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_db.sqlalchemy.engines [None req-690b97c2-849f-496e-8782-682cbeb2f56f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110436) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 11:31:30.741988 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_db.sqlalchemy.engines [None req-690b97c2-849f-496e-8782-682cbeb2f56f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110436) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 11:31:30.746254 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writer thread running {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 11:31:30.750457 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO dbcounter [None req-95238c99-da64-4791-a257-8fdda2158f54 None None] Registered counter for database nova_api Oct 18 11:31:30.773988 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG oslo_db.sqlalchemy.engines [None req-95238c99-da64-4791-a257-8fdda2158f54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110435) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 11:31:30.781355 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG dbcounter [-] [110435] Writer thread running {{(pid=110435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 11:31:30.842783 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.context [None req-95238c99-da64-4791-a257-8fdda2158f54 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7aca09e1-1559-4e39-9509-e923bbe1e225(cell1) {{(pid=110435) load_cells /opt/stack/nova/nova/context.py:464}} Oct 18 11:31:30.846999 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG oslo_concurrency.lockutils [None req-95238c99-da64-4791-a257-8fdda2158f54 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:31:30.847720 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG oslo_concurrency.lockutils [None req-95238c99-da64-4791-a257-8fdda2158f54 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:31:30.849504 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG oslo_concurrency.lockutils [None req-95238c99-da64-4791-a257-8fdda2158f54 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:31:30.850423 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG oslo_concurrency.lockutils [None req-95238c99-da64-4791-a257-8fdda2158f54 None None] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:31:30.851011 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG oslo_concurrency.lockutils [None req-95238c99-da64-4791-a257-8fdda2158f54 None None] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:31:30.853187 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG oslo_concurrency.lockutils [None req-95238c99-da64-4791-a257-8fdda2158f54 None None] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:31:30.855414 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO dbcounter [None req-95238c99-da64-4791-a257-8fdda2158f54 None None] Registered counter for database nova_cell0 Oct 18 11:31:30.860440 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO dbcounter [None req-95238c99-da64-4791-a257-8fdda2158f54 None None] Registered counter for database nova_cell1 Oct 18 11:31:30.869168 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG oslo_db.sqlalchemy.engines [None req-95238c99-da64-4791-a257-8fdda2158f54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110435) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 11:31:30.874462 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG dbcounter [-] [110435] Writer thread running {{(pid=110435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 11:31:30.875266 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG oslo_db.sqlalchemy.engines [None req-95238c99-da64-4791-a257-8fdda2158f54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110435) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 11:31:30.894090 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writer thread running {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 11:31:30.905488 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO dbcounter [None req-690b97c2-849f-496e-8782-682cbeb2f56f None None] Registered counter for database nova_cell0 Oct 18 11:31:30.917912 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_db.sqlalchemy.engines [None req-690b97c2-849f-496e-8782-682cbeb2f56f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110436) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 11:31:30.923943 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writer thread running {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 11:31:31.038178 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG dbcounter [-] [110435] Writer thread running {{(pid=110435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 11:31:31.048275 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO dbcounter [None req-95238c99-da64-4791-a257-8fdda2158f54 None None] Registered counter for database nova_cell0 Oct 18 11:31:31.058969 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG oslo_db.sqlalchemy.engines [None req-95238c99-da64-4791-a257-8fdda2158f54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110435) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 11:31:31.064881 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG dbcounter [-] [110435] Writer thread running {{(pid=110435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 11:31:31.278100 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: WARNING keystonemiddleware.auth_token [None req-690b97c2-849f-496e-8782-682cbeb2f56f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 11:31:31.286486 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: WARNING keystonemiddleware.auth_token [None req-690b97c2-849f-496e-8782-682cbeb2f56f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 11:31:31.394832 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: WARNING keystonemiddleware.auth_token [None req-95238c99-da64-4791-a257-8fdda2158f54 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 11:31:31.402509 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: WARNING keystonemiddleware.auth_token [None req-95238c99-da64-4791-a257-8fdda2158f54 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 11:31:31.626383 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: WARNING keystonemiddleware.auth_token [None req-690b97c2-849f-496e-8782-682cbeb2f56f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 11:31:31.633442 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: WARNING keystonemiddleware.auth_token [None req-690b97c2-849f-496e-8782-682cbeb2f56f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 11:31:31.639052 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ed338a99c0 pid: 110436 (default app) Oct 18 11:31:31.641394 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-690b97c2-849f-496e-8782-682cbeb2f56f None None] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:31:31.642662 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-690b97c2-849f-496e-8782-682cbeb2f56f None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001966 Oct 18 11:31:31.643149 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Tue Oct 18 11:31:31 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:31:31.750208 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: WARNING keystonemiddleware.auth_token [None req-95238c99-da64-4791-a257-8fdda2158f54 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 11:31:31.756993 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: WARNING keystonemiddleware.auth_token [None req-95238c99-da64-4791-a257-8fdda2158f54 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 11:31:31.762332 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ed338a99c0 pid: 110435 (default app) Oct 18 11:33:00.198680 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-690b97c2-849f-496e-8782-682cbeb2f56f None None] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:33:00.200364 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-690b97c2-849f-496e-8782-682cbeb2f56f None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002054 Oct 18 11:33:00.202226 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 2/2] 10.222.0.17 () {54 vars in 931 bytes} [Tue Oct 18 11:33:00 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:33:00.213618 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG dbcounter [-] [110435] Writing DB stats nova_api:SELECT=3 {{(pid=110435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:00.215220 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG dbcounter [-] [110435] Writing DB stats nova_cell0:SELECT=3 {{(pid=110435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:00.216796 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG dbcounter [-] [110435] Writing DB stats nova_cell1:SELECT=3 {{(pid=110435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:00.217692 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG dbcounter [-] [110435] Writing DB stats nova_cell0:SELECT=3 {{(pid=110435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:01.280294 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-0737bbed-39f2-407c-bc08-831739059302 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:33:01.322235 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-0737bbed-39f2-407c-bc08-831739059302 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.113774 Oct 18 11:33:01.323483 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 1/3] 10.222.0.17 () {60 vars in 1292 bytes} [Tue Oct 18 11:33:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:33:04.111887 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-690b97c2-849f-496e-8782-682cbeb2f56f None None] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:33:04.114150 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-690b97c2-849f-496e-8782-682cbeb2f56f None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002073 Oct 18 11:33:04.114980 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 3/4] 10.222.0.17 () {54 vars in 931 bytes} [Tue Oct 18 11:33:04 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:33:04.654464 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-f75351c9-ddd9-4343-9571-f24ccb90d00c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "cirros256", "vcpus": 1, "disk": 1, "ram": 256, "id": "c1"}} {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:33:04.712336 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-f75351c9-ddd9-4343-9571-f24ccb90d00c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.581841 Oct 18 11:33:04.712936 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 2/5] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Oct 18 11:33:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 11:33:04.728504 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writing DB stats nova_api:SELECT=3 {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:04.730069 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writing DB stats nova_cell1:SELECT=3 {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:04.732595 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writing DB stats nova_cell0:SELECT=3 {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:04.733509 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:04.950023 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-57dbcfce-343a-4c13-8501-36a10ea6a606 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:33:05.040203 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-57dbcfce-343a-4c13-8501-36a10ea6a606 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.317811 Oct 18 11:33:05.053379 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 4/6] 10.222.0.17 () {64 vars in 1336 bytes} [Tue Oct 18 11:33:04 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:33:07.758488 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-f75351c9-ddd9-4343-9571-f24ccb90d00c admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:33:07.759413 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-f75351c9-ddd9-4343-9571-f24ccb90d00c admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Oct 18 11:33:07.759816 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 3/7] 10.222.0.17 () {54 vars in 931 bytes} [Tue Oct 18 11:33:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:33:08.502330 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-63eb8564-67e9-4a4e-8fee-0bc43c1efcba admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 5, "ram": 512, "id": "d1", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "os-flavor-access:is_public": true}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:33:08.545612 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-63eb8564-67e9-4a4e-8fee-0bc43c1efcba admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.778908 Oct 18 11:33:08.546200 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 5/8] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Oct 18 11:33:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 11:33:08.558634 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-20db3504-d82f-4d16-a09d-1d4b01e2bfed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:33:08.601120 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-20db3504-d82f-4d16-a09d-1d4b01e2bfed admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044986 Oct 18 11:33:08.601120 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 4/9] 10.222.0.17 () {64 vars in 1336 bytes} [Tue Oct 18 11:33:08 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:33:11.359087 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-63eb8564-67e9-4a4e-8fee-0bc43c1efcba admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:33:11.360549 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-63eb8564-67e9-4a4e-8fee-0bc43c1efcba admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002161 Oct 18 11:33:11.361253 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 6/10] 10.222.0.17 () {54 vars in 931 bytes} [Tue Oct 18 11:33:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:33:11.863639 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-222090d6-23a7-4375-8f3d-a787fd0c4235 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "swap": 0, "id": "d2", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds1G", "disk": 10}} {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:33:11.886567 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-222090d6-23a7-4375-8f3d-a787fd0c4235 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.518057 Oct 18 11:33:11.887129 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 5/11] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Oct 18 11:33:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 11:33:11.900245 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-449a7859-5de9-4549-b752-269a14f97f9c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:33:11.931002 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-449a7859-5de9-4549-b752-269a14f97f9c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034616 Oct 18 11:33:11.931583 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 7/12] 10.222.0.17 () {64 vars in 1336 bytes} [Tue Oct 18 11:33:11 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:33:14.580272 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-222090d6-23a7-4375-8f3d-a787fd0c4235 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:33:14.581468 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-222090d6-23a7-4375-8f3d-a787fd0c4235 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001628 Oct 18 11:33:14.582211 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 6/13] 10.222.0.17 () {54 vars in 931 bytes} [Tue Oct 18 11:33:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:33:15.051781 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-2c1beed9-4c29-4a71-abfb-6115026d23ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d3", "vcpus": 2, "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0, "name": "ds2G"}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:33:15.070772 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-2c1beed9-4c29-4a71-abfb-6115026d23ef admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.482000 Oct 18 11:33:15.072027 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 8/14] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Oct 18 11:33:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 11:33:15.083922 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-41ee580a-7e79-4a24-8f5b-cb1205a78849 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:33:15.111896 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-41ee580a-7e79-4a24-8f5b-cb1205a78849 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031590 Oct 18 11:33:15.112697 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 7/15] 10.222.0.17 () {64 vars in 1336 bytes} [Tue Oct 18 11:33:15 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:33:17.863816 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-2c1beed9-4c29-4a71-abfb-6115026d23ef admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:33:17.864757 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-2c1beed9-4c29-4a71-abfb-6115026d23ef admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Oct 18 11:33:17.865215 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 9/16] 10.222.0.17 () {54 vars in 931 bytes} [Tue Oct 18 11:33:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:33:18.310562 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-ae9f26d2-16fb-424c-88b3-3f3249d816d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "swap": 0, "vcpus": 4, "disk": 20, "os-flavor-access:is_public": true, "id": "d4", "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:33:18.330216 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-ae9f26d2-16fb-424c-88b3-3f3249d816d2 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.457448 Oct 18 11:33:18.330773 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 8/17] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Oct 18 11:33:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 11:33:18.343309 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-671d0afb-68e8-43c5-9b89-f6972e9e0e87 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:33:18.376660 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-671d0afb-68e8-43c5-9b89-f6972e9e0e87 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037248 Oct 18 11:33:18.377301 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 10/18] 10.222.0.17 () {64 vars in 1336 bytes} [Tue Oct 18 11:33:18 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:33:21.004289 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-ae9f26d2-16fb-424c-88b3-3f3249d816d2 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:33:21.005432 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-ae9f26d2-16fb-424c-88b3-3f3249d816d2 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Oct 18 11:33:21.005833 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 9/19] 10.222.0.17 () {54 vars in 931 bytes} [Tue Oct 18 11:33:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:33:21.468908 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-4a29f91f-250e-4c3f-9fe9-502be965aacd admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:33:21.495026 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-4a29f91f-250e-4c3f-9fe9-502be965aacd admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.482712 Oct 18 11:33:21.495573 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 11/20] 10.222.0.17 () {60 vars in 1292 bytes} [Tue Oct 18 11:33:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:33:24.180933 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-ae9f26d2-16fb-424c-88b3-3f3249d816d2 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:33:24.182121 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-ae9f26d2-16fb-424c-88b3-3f3249d816d2 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002149 Oct 18 11:33:24.182526 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 10/21] 10.222.0.17 () {54 vars in 931 bytes} [Tue Oct 18 11:33:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:33:24.611816 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-0f97b64b-1150-4180-8581-96afc8ae81e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "swap": 0, "name": "m1.tiny", "vcpus": 1}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:33:24.633708 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-0f97b64b-1150-4180-8581-96afc8ae81e2 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.443875 Oct 18 11:33:24.634269 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 12/22] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Oct 18 11:33:24 2022] POST /compute/v2.1/flavors => generated 402 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 11:33:24.646901 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-88531c12-0951-44da-a483-ca0937f9e0e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:33:24.677608 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-88531c12-0951-44da-a483-ca0937f9e0e1 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034440 Oct 18 11:33:24.678200 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 11/23] 10.222.0.17 () {64 vars in 1333 bytes} [Tue Oct 18 11:33:24 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:33:27.296201 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-0f97b64b-1150-4180-8581-96afc8ae81e2 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:33:27.297261 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-0f97b64b-1150-4180-8581-96afc8ae81e2 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 18 11:33:27.297662 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 931 bytes} [Tue Oct 18 11:33:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:33:27.660521 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-1530d597-9959-4b65-aede-4175cb0e44b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "vcpus": 1, "id": "2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:33:27.682283 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-1530d597-9959-4b65-aede-4175cb0e44b0 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.378146 Oct 18 11:33:27.682861 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 12/25] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Oct 18 11:33:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 11:33:27.695291 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-5b92ad30-1432-4be4-85a7-d919f4350f27 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:33:27.724674 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-5b92ad30-1432-4be4-85a7-d919f4350f27 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033116 Oct 18 11:33:27.725772 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 14/26] 10.222.0.17 () {64 vars in 1333 bytes} [Tue Oct 18 11:33:27 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:33:30.386618 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-1530d597-9959-4b65-aede-4175cb0e44b0 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:33:30.387671 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-1530d597-9959-4b65-aede-4175cb0e44b0 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 18 11:33:30.388088 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 13/27] 10.222.0.17 () {54 vars in 931 bytes} [Tue Oct 18 11:33:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:33:30.882625 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-c672506f-3882-4f52-8d72-e6b990e5a6a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "id": "3", "ram": 4096, "name": "m1.medium", "disk": 40, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:33:30.917536 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-c672506f-3882-4f52-8d72-e6b990e5a6a5 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.523147 Oct 18 11:33:30.926245 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 15/28] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Oct 18 11:33:30 2022] POST /compute/v2.1/flavors => generated 406 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 11:33:30.931238 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-c8e98883-25f6-48e8-8c4d-3aaebb664f77 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:33:30.942315 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG dbcounter [-] [110435] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=110435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:30.961207 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-c8e98883-25f6-48e8-8c4d-3aaebb664f77 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033601 Oct 18 11:33:30.985457 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 14/29] 10.222.0.17 () {64 vars in 1333 bytes} [Tue Oct 18 11:33:30 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:33:33.595589 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-c672506f-3882-4f52-8d72-e6b990e5a6a5 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:33:33.596518 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-c672506f-3882-4f52-8d72-e6b990e5a6a5 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 18 11:33:33.596940 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 16/30] 10.222.0.17 () {54 vars in 931 bytes} [Tue Oct 18 11:33:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:33:34.069210 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-efa229fb-dc15-4d8c-a925-1b924ed7c38b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 8192, "disk": 80, "os-flavor-access:is_public": true, "name": "m1.large", "swap": 0, "vcpus": 4}} {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:33:34.090672 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-efa229fb-dc15-4d8c-a925-1b924ed7c38b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.487085 Oct 18 11:33:34.091539 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 15/31] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Oct 18 11:33:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 11:33:34.103585 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-bbb6a4e2-1c82-4bcf-9e3c-d5b16368d228 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:33:34.130148 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-bbb6a4e2-1c82-4bcf-9e3c-d5b16368d228 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030442 Oct 18 11:33:34.130747 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 17/32] 10.222.0.17 () {64 vars in 1333 bytes} [Tue Oct 18 11:33:34 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:33:36.817868 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-efa229fb-dc15-4d8c-a925-1b924ed7c38b admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:33:36.819511 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-efa229fb-dc15-4d8c-a925-1b924ed7c38b admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002074 Oct 18 11:33:36.819910 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 16/33] 10.222.0.17 () {54 vars in 931 bytes} [Tue Oct 18 11:33:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:33:37.303734 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-65497804-f2f6-40e1-b4ff-0a10ae507513 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "ram": 16384, "disk": 160, "rxtx_factor": 1.0, "swap": 0}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:33:37.320219 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:37.334458 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-65497804-f2f6-40e1-b4ff-0a10ae507513 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.507633 Oct 18 11:33:37.340893 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 18/34] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Oct 18 11:33:36 2022] POST /compute/v2.1/flavors => generated 408 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 11:33:37.348125 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-a7398707-159a-4455-bda7-52df1fc31240 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:33:37.379387 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-a7398707-159a-4455-bda7-52df1fc31240 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034941 Oct 18 11:33:37.380070 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 17/35] 10.222.0.17 () {64 vars in 1333 bytes} [Tue Oct 18 11:33:37 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:33:54.281025 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-65497804-f2f6-40e1-b4ff-0a10ae507513 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:33:54.282174 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-65497804-f2f6-40e1-b4ff-0a10ae507513 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001659 Oct 18 11:33:54.282658 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 19/36] 10.222.0.17 () {54 vars in 931 bytes} [Tue Oct 18 11:33:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:33:54.294738 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG dbcounter [-] [110435] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=110435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:54.822508 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-be3483ef-6bcb-4d97-a309-2c90fab5a647 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:33:54.844924 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-be3483ef-6bcb-4d97-a309-2c90fab5a647 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.555206 Oct 18 11:33:54.845619 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 18/37] 10.222.0.17 () {60 vars in 1292 bytes} [Tue Oct 18 11:33:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:33:56.303341 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-65497804-f2f6-40e1-b4ff-0a10ae507513 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:33:56.304801 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-65497804-f2f6-40e1-b4ff-0a10ae507513 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002012 Oct 18 11:33:56.305418 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 20/38] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Oct 18 11:33:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:33:56.971057 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-c0506d4d-638b-4a8d-9cf8-201473071808 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:33:56.977483 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.wsgi [None req-c0506d4d-638b-4a8d-9cf8-201473071808 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 18 11:33:56.981352 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-c0506d4d-638b-4a8d-9cf8-201473071808 admin admin] Request method failure captured: Oct 18 11:33:56.981352 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 18 11:33:56.981352 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: Accept: application/json Oct 18 11:33:56.981352 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: Accept-Encoding: gzip, deflate Oct 18 11:33:56.981352 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: Connection: keep-alive Oct 18 11:33:56.981352 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: Content-Length: 0 Oct 18 11:33:56.981352 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: Host: 10.222.0.17 Oct 18 11:33:56.981352 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: Openstack-Api-Version: compute 2.92 Oct 18 11:33:56.981352 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: Openstack-System-Scope: None Oct 18 11:33:56.981352 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: User-Agent: python-novaclient Oct 18 11:33:56.981352 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Auth-Token: gAAAAABjTo8ki-pmo3RmjrTkupf6irpJKUJKc_EG7RgNPRWRVJcn_JYqDE-TfUI9faSxpcnCQizgGNiryo9SL_v2veFzeDS_l9wT2qsPJBsVdbWR9eSfwlI6-Wepep_96gTgWxbxx77onJwkQkLpusJWLHToRFpfcw2kKc8EBWLWYqZcDgvWiJQ Oct 18 11:33:56.981352 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Domain-Id: None Oct 18 11:33:56.981352 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Domain-Name: None Oct 18 11:33:56.981352 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Identity-Status: Confirmed Oct 18 11:33:56.981352 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Is-Admin-Project: True Oct 18 11:33:56.981352 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Openstack-Nova-Api-Version: 2.92 Oct 18 11:33:56.981352 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Project-Domain-Id: default Oct 18 11:33:56.981352 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Project-Domain-Name: Default Oct 18 11:33:56.981352 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Project-Id: 4c023e59351c4a06998c34820bba9111 Oct 18 11:33:56.981352 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Project-Name: admin Oct 18 11:33:56.981352 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Role: reader,member,admin Oct 18 11:33:56.981352 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Roles: reader,member,admin Oct 18 11:33:56.983412 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c023e59351c4a06998c34820bba9111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c023e59351c4a06998c34820bba9111"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c023e59351c4a06998c34820bba9111"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c023e59351c4a06998c34820bba9111"}]}] Oct 18 11:33:56.983412 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Tenant: admin Oct 18 11:33:56.983412 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Tenant-Id: 4c023e59351c4a06998c34820bba9111 Oct 18 11:33:56.983412 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Tenant-Name: admin Oct 18 11:33:56.983412 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-User: admin Oct 18 11:33:56.983412 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-User-Domain-Id: default Oct 18 11:33:56.983412 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-User-Domain-Name: Default Oct 18 11:33:56.983412 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-User-Id: c5f193bd980d483b8200f674f5249745 Oct 18 11:33:56.983412 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-User-Name: admin Oct 18 11:33:56.983412 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: method: > Oct 18 11:33:56.983412 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: exception: Flavor 42 could not be found. Oct 18 11:33:56.983412 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: action_args: {'id': '42'} Oct 18 11:33:56.983412 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:33:56.983412 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:33:56.984504 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 18 11:33:56.984504 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 18 11:33:56.984504 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 11:33:56.984504 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 11:33:56.984504 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 11:33:56.984504 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 11:33:56.984504 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 11:33:56.984504 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 11:33:56.984504 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 11:33:56.984504 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:33:56.984504 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 11:33:56.984504 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 11:33:56.984504 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 18 11:33:56.984504 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Oct 18 11:33:56.984504 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:33:56.984504 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Oct 18 11:33:56.984504 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:33:56.984504 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:33:56.984504 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:33:56.986851 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:33:56.986851 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:33:56.986851 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:33:56.986851 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:33:56.986851 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 18 11:33:56.986851 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:33:56.986851 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 18 11:33:56.986851 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Oct 18 11:33:56.986851 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:33:56.986851 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Oct 18 11:33:56.986851 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:33:56.986851 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:33:56.986851 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:33:56.986851 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:33:56.986851 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:33:56.986851 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 18 11:33:56.986851 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Oct 18 11:33:56.986851 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-c0506d4d-638b-4a8d-9cf8-201473071808 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:33:56.989268 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-c0506d4d-638b-4a8d-9cf8-201473071808 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.497919 Oct 18 11:33:56.989268 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 19/39] 10.222.0.17 () {60 vars in 1190 bytes} [Tue Oct 18 11:33:56 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 499 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 18 11:33:56.993362 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-592c2c6c-ab79-4da3-881a-d26a8ef3f27a admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:33:57.020415 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-592c2c6c-ab79-4da3-881a-d26a8ef3f27a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.030558 Oct 18 11:33:57.021041 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 21/40] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Oct 18 11:33:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:33:57.032498 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-5914511c-d2ee-497a-b2bb-f134a8b4d42d admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:33:57.056331 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-5914511c-d2ee-497a-b2bb-f134a8b4d42d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028479 Oct 18 11:33:57.057012 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 20/41] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Oct 18 11:33:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:33:57.069204 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-c4a775ae-e4c1-4eaf-8d0a-3fa0e866c857 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:33:57.076226 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.wsgi [None req-c4a775ae-e4c1-4eaf-8d0a-3fa0e866c857 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 18 11:33:57.080006 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-c4a775ae-e4c1-4eaf-8d0a-3fa0e866c857 admin admin] Request method failure captured: Oct 18 11:33:57.080006 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 18 11:33:57.080006 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: Accept: application/json Oct 18 11:33:57.080006 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: Accept-Encoding: gzip, deflate Oct 18 11:33:57.080006 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: Connection: keep-alive Oct 18 11:33:57.080006 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: Content-Length: 0 Oct 18 11:33:57.080006 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: Host: 10.222.0.17 Oct 18 11:33:57.080006 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: Openstack-Api-Version: compute 2.92 Oct 18 11:33:57.080006 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: Openstack-System-Scope: None Oct 18 11:33:57.080006 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: User-Agent: python-novaclient Oct 18 11:33:57.080006 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Auth-Token: gAAAAABjTo8ki-pmo3RmjrTkupf6irpJKUJKc_EG7RgNPRWRVJcn_JYqDE-TfUI9faSxpcnCQizgGNiryo9SL_v2veFzeDS_l9wT2qsPJBsVdbWR9eSfwlI6-Wepep_96gTgWxbxx77onJwkQkLpusJWLHToRFpfcw2kKc8EBWLWYqZcDgvWiJQ Oct 18 11:33:57.080006 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Domain-Id: None Oct 18 11:33:57.080006 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Domain-Name: None Oct 18 11:33:57.080006 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Identity-Status: Confirmed Oct 18 11:33:57.080006 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Is-Admin-Project: True Oct 18 11:33:57.080006 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Openstack-Nova-Api-Version: 2.92 Oct 18 11:33:57.080006 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Project-Domain-Id: default Oct 18 11:33:57.080006 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Project-Domain-Name: Default Oct 18 11:33:57.080006 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Project-Id: 4c023e59351c4a06998c34820bba9111 Oct 18 11:33:57.080006 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Project-Name: admin Oct 18 11:33:57.080006 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Role: reader,member,admin Oct 18 11:33:57.080006 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Roles: reader,member,admin Oct 18 11:33:57.082387 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c023e59351c4a06998c34820bba9111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c023e59351c4a06998c34820bba9111"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c023e59351c4a06998c34820bba9111"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c023e59351c4a06998c34820bba9111"}]}] Oct 18 11:33:57.082387 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Tenant: admin Oct 18 11:33:57.082387 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Tenant-Id: 4c023e59351c4a06998c34820bba9111 Oct 18 11:33:57.082387 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Tenant-Name: admin Oct 18 11:33:57.082387 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-User: admin Oct 18 11:33:57.082387 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-User-Domain-Id: default Oct 18 11:33:57.082387 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-User-Domain-Name: Default Oct 18 11:33:57.082387 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-User-Id: c5f193bd980d483b8200f674f5249745 Oct 18 11:33:57.082387 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-User-Name: admin Oct 18 11:33:57.082387 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: method: > Oct 18 11:33:57.082387 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: exception: Flavor 42 could not be found. Oct 18 11:33:57.082387 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: action_args: {'id': '42'} Oct 18 11:33:57.082387 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:33:57.082387 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:33:57.083997 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 18 11:33:57.083997 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 18 11:33:57.083997 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 11:33:57.083997 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 11:33:57.083997 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 11:33:57.083997 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 11:33:57.083997 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 11:33:57.083997 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 11:33:57.083997 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 11:33:57.083997 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:33:57.083997 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 11:33:57.083997 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 11:33:57.083997 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 18 11:33:57.083997 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Oct 18 11:33:57.083997 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:33:57.083997 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Oct 18 11:33:57.083997 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:33:57.083997 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:33:57.083997 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:33:57.085967 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:33:57.085967 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:33:57.085967 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:33:57.085967 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:33:57.085967 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 18 11:33:57.085967 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:33:57.085967 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 18 11:33:57.085967 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Oct 18 11:33:57.085967 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:33:57.085967 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Oct 18 11:33:57.085967 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:33:57.085967 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:33:57.085967 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:33:57.085967 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:33:57.085967 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:33:57.085967 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 18 11:33:57.085967 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Oct 18 11:33:57.085967 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-c4a775ae-e4c1-4eaf-8d0a-3fa0e866c857 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:33:57.088039 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-c4a775ae-e4c1-4eaf-8d0a-3fa0e866c857 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.017028 Oct 18 11:33:57.088039 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 22/42] 10.222.0.17 () {60 vars in 1190 bytes} [Tue Oct 18 11:33:57 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 18 11:33:58.425579 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-5914511c-d2ee-497a-b2bb-f134a8b4d42d admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:33:58.426540 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-5914511c-d2ee-497a-b2bb-f134a8b4d42d admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001708 Oct 18 11:33:58.427035 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 21/43] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Oct 18 11:33:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:33:59.031492 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-436e9561-70e8-41aa-b0e5-ed5635eaa77f admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:33:59.036821 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.wsgi [None req-436e9561-70e8-41aa-b0e5-ed5635eaa77f admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 18 11:33:59.038474 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-436e9561-70e8-41aa-b0e5-ed5635eaa77f admin admin] Request method failure captured: Oct 18 11:33:59.038474 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 18 11:33:59.038474 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: Accept: application/json Oct 18 11:33:59.038474 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: Accept-Encoding: gzip, deflate Oct 18 11:33:59.038474 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: Connection: keep-alive Oct 18 11:33:59.038474 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: Content-Length: 0 Oct 18 11:33:59.038474 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: Host: 10.222.0.17 Oct 18 11:33:59.038474 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: Openstack-Api-Version: compute 2.92 Oct 18 11:33:59.038474 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: Openstack-System-Scope: None Oct 18 11:33:59.038474 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: User-Agent: python-novaclient Oct 18 11:33:59.038474 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Auth-Token: gAAAAABjTo8m6guLtdYW64T-ZihCzwVsOagujgfiHz_vTmaSg0mMV4euiQQsS_AVcM70-54QDu0qtOUq3Y1AgoR473MsER6sv3flq5EvUHNqIp9QXz5P7GRp5wSy4_CqG3fYpPbgVWTD8QqFJn8wvCYIoxivluapR7657WZ3igUuj5cv24NLuoY Oct 18 11:33:59.038474 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Domain-Id: None Oct 18 11:33:59.038474 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Domain-Name: None Oct 18 11:33:59.038474 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Identity-Status: Confirmed Oct 18 11:33:59.038474 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Is-Admin-Project: True Oct 18 11:33:59.038474 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Openstack-Nova-Api-Version: 2.92 Oct 18 11:33:59.038474 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Project-Domain-Id: default Oct 18 11:33:59.038474 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Project-Domain-Name: Default Oct 18 11:33:59.038474 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Project-Id: 4c023e59351c4a06998c34820bba9111 Oct 18 11:33:59.038474 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Project-Name: admin Oct 18 11:33:59.038474 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Role: reader,member,admin Oct 18 11:33:59.038474 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Roles: reader,member,admin Oct 18 11:33:59.040106 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c023e59351c4a06998c34820bba9111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c023e59351c4a06998c34820bba9111"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c023e59351c4a06998c34820bba9111"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c023e59351c4a06998c34820bba9111"}]}] Oct 18 11:33:59.040106 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Tenant: admin Oct 18 11:33:59.040106 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Tenant-Id: 4c023e59351c4a06998c34820bba9111 Oct 18 11:33:59.040106 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Tenant-Name: admin Oct 18 11:33:59.040106 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-User: admin Oct 18 11:33:59.040106 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-User-Domain-Id: default Oct 18 11:33:59.040106 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-User-Domain-Name: Default Oct 18 11:33:59.040106 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-User-Id: c5f193bd980d483b8200f674f5249745 Oct 18 11:33:59.040106 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-User-Name: admin Oct 18 11:33:59.040106 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: method: > Oct 18 11:33:59.040106 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: exception: Flavor 84 could not be found. Oct 18 11:33:59.040106 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: action_args: {'id': '84'} Oct 18 11:33:59.040106 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:33:59.040106 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:33:59.041587 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 18 11:33:59.041587 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 18 11:33:59.041587 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 11:33:59.041587 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 11:33:59.041587 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 11:33:59.041587 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 11:33:59.041587 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 11:33:59.041587 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 11:33:59.041587 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 11:33:59.041587 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:33:59.041587 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 11:33:59.041587 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 11:33:59.041587 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 18 11:33:59.041587 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Oct 18 11:33:59.041587 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:33:59.041587 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Oct 18 11:33:59.041587 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:33:59.041587 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:33:59.041587 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:33:59.042854 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:33:59.042854 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:33:59.042854 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:33:59.042854 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:33:59.042854 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 18 11:33:59.042854 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:33:59.042854 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 18 11:33:59.042854 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Oct 18 11:33:59.042854 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:33:59.042854 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Oct 18 11:33:59.042854 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:33:59.042854 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:33:59.042854 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:33:59.042854 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:33:59.042854 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:33:59.042854 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 18 11:33:59.042854 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Oct 18 11:33:59.042854 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-436e9561-70e8-41aa-b0e5-ed5635eaa77f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:33:59.044301 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-436e9561-70e8-41aa-b0e5-ed5635eaa77f admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.465510 Oct 18 11:33:59.044301 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 23/44] 10.222.0.17 () {60 vars in 1190 bytes} [Tue Oct 18 11:33:58 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 467 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 18 11:33:59.050206 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-d0f43b81-6deb-432a-8522-b44598cd0d23 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:33:59.066241 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-d0f43b81-6deb-432a-8522-b44598cd0d23 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019777 Oct 18 11:33:59.066869 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 22/45] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Oct 18 11:33:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:33:59.077849 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-6946efbe-4caa-4ae8-901a-da5c82ef8e33 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:33:59.094693 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-6946efbe-4caa-4ae8-901a-da5c82ef8e33 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021098 Oct 18 11:33:59.095313 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 24/46] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Oct 18 11:33:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:33:59.108422 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-b8061b64-9679-495e-9e8b-7ca8820168a7 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:33:59.115563 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.wsgi [None req-b8061b64-9679-495e-9e8b-7ca8820168a7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 18 11:33:59.117767 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-b8061b64-9679-495e-9e8b-7ca8820168a7 admin admin] Request method failure captured: Oct 18 11:33:59.117767 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 18 11:33:59.117767 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: Accept: application/json Oct 18 11:33:59.117767 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: Accept-Encoding: gzip, deflate Oct 18 11:33:59.117767 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: Connection: keep-alive Oct 18 11:33:59.117767 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: Content-Length: 0 Oct 18 11:33:59.117767 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: Host: 10.222.0.17 Oct 18 11:33:59.117767 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: Openstack-Api-Version: compute 2.92 Oct 18 11:33:59.117767 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: Openstack-System-Scope: None Oct 18 11:33:59.117767 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: User-Agent: python-novaclient Oct 18 11:33:59.117767 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Auth-Token: gAAAAABjTo8m6guLtdYW64T-ZihCzwVsOagujgfiHz_vTmaSg0mMV4euiQQsS_AVcM70-54QDu0qtOUq3Y1AgoR473MsER6sv3flq5EvUHNqIp9QXz5P7GRp5wSy4_CqG3fYpPbgVWTD8QqFJn8wvCYIoxivluapR7657WZ3igUuj5cv24NLuoY Oct 18 11:33:59.117767 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Domain-Id: None Oct 18 11:33:59.117767 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Domain-Name: None Oct 18 11:33:59.117767 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Identity-Status: Confirmed Oct 18 11:33:59.117767 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Is-Admin-Project: True Oct 18 11:33:59.117767 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Openstack-Nova-Api-Version: 2.92 Oct 18 11:33:59.117767 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Project-Domain-Id: default Oct 18 11:33:59.117767 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Project-Domain-Name: Default Oct 18 11:33:59.117767 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Project-Id: 4c023e59351c4a06998c34820bba9111 Oct 18 11:33:59.117767 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Project-Name: admin Oct 18 11:33:59.117767 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Role: reader,member,admin Oct 18 11:33:59.117767 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Roles: reader,member,admin Oct 18 11:33:59.119383 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c023e59351c4a06998c34820bba9111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c023e59351c4a06998c34820bba9111"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c023e59351c4a06998c34820bba9111"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c023e59351c4a06998c34820bba9111"}]}] Oct 18 11:33:59.119383 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Tenant: admin Oct 18 11:33:59.119383 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Tenant-Id: 4c023e59351c4a06998c34820bba9111 Oct 18 11:33:59.119383 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Tenant-Name: admin Oct 18 11:33:59.119383 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-User: admin Oct 18 11:33:59.119383 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-User-Domain-Id: default Oct 18 11:33:59.119383 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-User-Domain-Name: Default Oct 18 11:33:59.119383 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-User-Id: c5f193bd980d483b8200f674f5249745 Oct 18 11:33:59.119383 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-User-Name: admin Oct 18 11:33:59.119383 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: method: > Oct 18 11:33:59.119383 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: exception: Flavor 84 could not be found. Oct 18 11:33:59.119383 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: action_args: {'id': '84'} Oct 18 11:33:59.119383 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:33:59.119383 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:33:59.121222 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 18 11:33:59.121222 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 18 11:33:59.121222 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 11:33:59.121222 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 11:33:59.121222 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 11:33:59.121222 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 11:33:59.121222 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 11:33:59.121222 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 11:33:59.121222 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 11:33:59.121222 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:33:59.121222 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 11:33:59.121222 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 11:33:59.121222 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 18 11:33:59.121222 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Oct 18 11:33:59.121222 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:33:59.121222 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Oct 18 11:33:59.121222 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:33:59.121222 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:33:59.121222 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:33:59.122741 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:33:59.122741 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:33:59.122741 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:33:59.122741 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:33:59.122741 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 18 11:33:59.122741 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:33:59.122741 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 18 11:33:59.122741 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Oct 18 11:33:59.122741 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:33:59.122741 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Oct 18 11:33:59.122741 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:33:59.122741 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:33:59.122741 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:33:59.122741 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:33:59.122741 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:33:59.122741 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 18 11:33:59.122741 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Oct 18 11:33:59.122741 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-b8061b64-9679-495e-9e8b-7ca8820168a7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:33:59.123962 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-b8061b64-9679-495e-9e8b-7ca8820168a7 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.017857 Oct 18 11:33:59.123962 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 23/47] 10.222.0.17 () {60 vars in 1190 bytes} [Tue Oct 18 11:33:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 18 11:34:00.504231 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-6946efbe-4caa-4ae8-901a-da5c82ef8e33 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:34:00.505368 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-6946efbe-4caa-4ae8-901a-da5c82ef8e33 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001702 Oct 18 11:34:00.505797 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 25/48] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Oct 18 11:34:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:34:01.173001 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-72a8c162-3382-48d5-abe2-f375194d5a74 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:34:01.179883 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.wsgi [None req-72a8c162-3382-48d5-abe2-f375194d5a74 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 18 11:34:01.181780 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-72a8c162-3382-48d5-abe2-f375194d5a74 admin admin] Request method failure captured: Oct 18 11:34:01.181780 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 18 11:34:01.181780 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: Accept: application/json Oct 18 11:34:01.181780 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: Accept-Encoding: gzip, deflate Oct 18 11:34:01.181780 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: Connection: keep-alive Oct 18 11:34:01.181780 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: Content-Length: 0 Oct 18 11:34:01.181780 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: Host: 10.222.0.17 Oct 18 11:34:01.181780 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: Openstack-Api-Version: compute 2.92 Oct 18 11:34:01.181780 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: Openstack-System-Scope: None Oct 18 11:34:01.181780 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: User-Agent: python-novaclient Oct 18 11:34:01.181780 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Auth-Token: gAAAAABjTo8oySap79S-1rzQKWa2EPey5d73xMBgdvUMo8_qys_5EpQ7nq50-M8hiM1tt37JOydr72qvLIfIb_bGUL6vu2FcthMj4CNx2qjJe4bECwcnkNGKdFFH8sETcMP3KDEQzRbQoc72KcQ9QKFHsDHEEyLYpx36Nw8G8ZNETikTDPfLVRA Oct 18 11:34:01.181780 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Domain-Id: None Oct 18 11:34:01.181780 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Domain-Name: None Oct 18 11:34:01.181780 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Identity-Status: Confirmed Oct 18 11:34:01.181780 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Is-Admin-Project: True Oct 18 11:34:01.181780 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Openstack-Nova-Api-Version: 2.92 Oct 18 11:34:01.181780 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Project-Domain-Id: default Oct 18 11:34:01.181780 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Project-Domain-Name: Default Oct 18 11:34:01.181780 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Project-Id: 4c023e59351c4a06998c34820bba9111 Oct 18 11:34:01.181780 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Project-Name: admin Oct 18 11:34:01.181780 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Role: reader,member,admin Oct 18 11:34:01.181780 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Roles: reader,member,admin Oct 18 11:34:01.185426 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c023e59351c4a06998c34820bba9111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c023e59351c4a06998c34820bba9111"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c023e59351c4a06998c34820bba9111"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c023e59351c4a06998c34820bba9111"}]}] Oct 18 11:34:01.185426 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Tenant: admin Oct 18 11:34:01.185426 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Tenant-Id: 4c023e59351c4a06998c34820bba9111 Oct 18 11:34:01.185426 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-Tenant-Name: admin Oct 18 11:34:01.185426 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-User: admin Oct 18 11:34:01.185426 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-User-Domain-Id: default Oct 18 11:34:01.185426 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-User-Domain-Name: Default Oct 18 11:34:01.185426 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-User-Id: c5f193bd980d483b8200f674f5249745 Oct 18 11:34:01.185426 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: X-User-Name: admin Oct 18 11:34:01.185426 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: method: > Oct 18 11:34:01.185426 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: exception: Flavor 451 could not be found. Oct 18 11:34:01.185426 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: action_args: {'id': '451'} Oct 18 11:34:01.185426 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:34:01.185426 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:34:01.187223 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 18 11:34:01.187223 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 18 11:34:01.187223 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 11:34:01.187223 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 11:34:01.187223 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 11:34:01.187223 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 11:34:01.187223 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 11:34:01.187223 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 11:34:01.187223 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 11:34:01.187223 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:34:01.187223 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 11:34:01.187223 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 11:34:01.187223 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 18 11:34:01.187223 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Oct 18 11:34:01.187223 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:34:01.187223 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Oct 18 11:34:01.187223 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:34:01.187223 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:34:01.187223 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:34:01.188422 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:34:01.188422 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:34:01.188422 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:34:01.188422 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:34:01.188422 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 18 11:34:01.188422 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:34:01.188422 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 18 11:34:01.188422 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Oct 18 11:34:01.188422 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:34:01.188422 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Oct 18 11:34:01.188422 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:34:01.188422 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:34:01.188422 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:34:01.188422 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:34:01.188422 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:34:01.188422 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 18 11:34:01.188422 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Oct 18 11:34:01.188422 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-72a8c162-3382-48d5-abe2-f375194d5a74 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:34:01.189695 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-72a8c162-3382-48d5-abe2-f375194d5a74 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.526116 Oct 18 11:34:01.189695 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 24/49] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Oct 18 11:34:00 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 528 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 18 11:34:01.196899 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-36045b6d-f064-4d4a-8578-6bf0563ac6a9 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:34:01.212369 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-36045b6d-f064-4d4a-8578-6bf0563ac6a9 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019528 Oct 18 11:34:01.212958 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 26/50] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Oct 18 11:34:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:34:01.226400 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-cb941d74-df97-4063-aa8d-be5432ac8795 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:34:01.252677 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-cb941d74-df97-4063-aa8d-be5432ac8795 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.032568 Oct 18 11:34:01.253924 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 25/51] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Oct 18 11:34:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:34:01.266687 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-74a012d6-b159-4712-8167-72efc103e06d admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:34:01.274116 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.wsgi [None req-74a012d6-b159-4712-8167-72efc103e06d admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 18 11:34:01.275762 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-74a012d6-b159-4712-8167-72efc103e06d admin admin] Request method failure captured: Oct 18 11:34:01.275762 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 18 11:34:01.275762 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: Accept: application/json Oct 18 11:34:01.275762 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: Accept-Encoding: gzip, deflate Oct 18 11:34:01.275762 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: Connection: keep-alive Oct 18 11:34:01.275762 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: Content-Length: 0 Oct 18 11:34:01.275762 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: Host: 10.222.0.17 Oct 18 11:34:01.275762 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: Openstack-Api-Version: compute 2.92 Oct 18 11:34:01.275762 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: Openstack-System-Scope: None Oct 18 11:34:01.275762 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: User-Agent: python-novaclient Oct 18 11:34:01.275762 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Auth-Token: gAAAAABjTo8oySap79S-1rzQKWa2EPey5d73xMBgdvUMo8_qys_5EpQ7nq50-M8hiM1tt37JOydr72qvLIfIb_bGUL6vu2FcthMj4CNx2qjJe4bECwcnkNGKdFFH8sETcMP3KDEQzRbQoc72KcQ9QKFHsDHEEyLYpx36Nw8G8ZNETikTDPfLVRA Oct 18 11:34:01.275762 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Domain-Id: None Oct 18 11:34:01.275762 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Domain-Name: None Oct 18 11:34:01.275762 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Identity-Status: Confirmed Oct 18 11:34:01.275762 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Is-Admin-Project: True Oct 18 11:34:01.275762 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Openstack-Nova-Api-Version: 2.92 Oct 18 11:34:01.275762 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Project-Domain-Id: default Oct 18 11:34:01.275762 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Project-Domain-Name: Default Oct 18 11:34:01.275762 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Project-Id: 4c023e59351c4a06998c34820bba9111 Oct 18 11:34:01.275762 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Project-Name: admin Oct 18 11:34:01.275762 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Role: reader,member,admin Oct 18 11:34:01.275762 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Roles: reader,member,admin Oct 18 11:34:01.277803 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c023e59351c4a06998c34820bba9111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4c023e59351c4a06998c34820bba9111"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4c023e59351c4a06998c34820bba9111"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4c023e59351c4a06998c34820bba9111"}]}] Oct 18 11:34:01.277803 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Tenant: admin Oct 18 11:34:01.277803 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Tenant-Id: 4c023e59351c4a06998c34820bba9111 Oct 18 11:34:01.277803 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-Tenant-Name: admin Oct 18 11:34:01.277803 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-User: admin Oct 18 11:34:01.277803 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-User-Domain-Id: default Oct 18 11:34:01.277803 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-User-Domain-Name: Default Oct 18 11:34:01.277803 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-User-Id: c5f193bd980d483b8200f674f5249745 Oct 18 11:34:01.277803 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: X-User-Name: admin Oct 18 11:34:01.277803 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: method: > Oct 18 11:34:01.277803 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: exception: Flavor 451 could not be found. Oct 18 11:34:01.277803 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: action_args: {'id': '451'} Oct 18 11:34:01.277803 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:34:01.277803 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:34:01.278605 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 18 11:34:01.278605 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 18 11:34:01.278605 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 11:34:01.278605 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 11:34:01.278605 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 11:34:01.278605 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 11:34:01.278605 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 11:34:01.278605 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 11:34:01.278605 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 11:34:01.278605 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:34:01.278605 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 11:34:01.278605 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 11:34:01.278605 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 18 11:34:01.278605 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Oct 18 11:34:01.278605 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:34:01.278605 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Oct 18 11:34:01.278605 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:34:01.278605 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:34:01.278605 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:34:01.280780 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:34:01.280780 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:34:01.280780 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:34:01.280780 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:34:01.280780 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 18 11:34:01.280780 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:34:01.280780 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 18 11:34:01.280780 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Oct 18 11:34:01.280780 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:34:01.280780 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Oct 18 11:34:01.280780 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:34:01.280780 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:34:01.280780 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:34:01.280780 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:34:01.280780 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:34:01.280780 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 18 11:34:01.280780 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Oct 18 11:34:01.280780 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-74a012d6-b159-4712-8167-72efc103e06d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:34:01.281857 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-74a012d6-b159-4712-8167-72efc103e06d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.014955 Oct 18 11:34:01.281857 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 27/52] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Oct 18 11:34:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 18 11:34:02.637981 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-cb941d74-df97-4063-aa8d-be5432ac8795 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:34:02.639082 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-cb941d74-df97-4063-aa8d-be5432ac8795 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Oct 18 11:34:02.639481 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 26/53] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Oct 18 11:34:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:34:03.240612 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-514b61b5-bff5-4fdb-9c21-99b764573ee8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:34:03.264228 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-514b61b5-bff5-4fdb-9c21-99b764573ee8 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.479780 Oct 18 11:34:03.264952 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 28/54] 10.222.0.17 () {64 vars in 1235 bytes} [Tue Oct 18 11:34:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 11:34:04.608618 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-cb941d74-df97-4063-aa8d-be5432ac8795 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:34:04.610539 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-cb941d74-df97-4063-aa8d-be5432ac8795 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002626 Oct 18 11:34:04.611272 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 27/55] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Oct 18 11:34:04 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:34:05.189900 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-ea76f86b-f7bd-4cbe-bba6-5a4885234830 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:34:05.216160 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-ea76f86b-f7bd-4cbe-bba6-5a4885234830 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.457551 Oct 18 11:34:05.217221 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 29/56] 10.222.0.17 () {64 vars in 1235 bytes} [Tue Oct 18 11:34:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 11:34:06.552206 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-cb941d74-df97-4063-aa8d-be5432ac8795 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:34:06.553433 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-cb941d74-df97-4063-aa8d-be5432ac8795 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001675 Oct 18 11:34:06.553836 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 28/57] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Oct 18 11:34:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:34:07.111993 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-fee30db2-eda6-4251-86fa-d1b34b32d281 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:34:07.133671 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-fee30db2-eda6-4251-86fa-d1b34b32d281 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.440672 Oct 18 11:34:07.134863 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 30/58] 10.222.0.17 () {64 vars in 1235 bytes} [Tue Oct 18 11:34:06 2022] POST /compute/v2.1/flavors => generated 407 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 11:34:08.431745 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-cb941d74-df97-4063-aa8d-be5432ac8795 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:34:08.433328 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-cb941d74-df97-4063-aa8d-be5432ac8795 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Oct 18 11:34:08.433736 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 29/59] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Oct 18 11:34:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:34:09.080078 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-31c981cd-1634-42f4-b6c6-0da3557883b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:34:09.100490 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-31c981cd-1634-42f4-b6c6-0da3557883b1 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.518991 Oct 18 11:34:09.101073 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 31/60] 10.222.0.17 () {64 vars in 1235 bytes} [Tue Oct 18 11:34:08 2022] POST /compute/v2.1/flavors => generated 409 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 11:34:10.415048 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-cb941d74-df97-4063-aa8d-be5432ac8795 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:34:10.416092 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-cb941d74-df97-4063-aa8d-be5432ac8795 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Oct 18 11:34:10.416495 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 30/61] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Oct 18 11:34:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:34:11.007619 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-d8e0d507-2a87-4be5-8ce1-def0cb9ecde2 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:34:11.031032 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-d8e0d507-2a87-4be5-8ce1-def0cb9ecde2 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.463725 Oct 18 11:34:11.031593 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 32/62] 10.222.0.17 () {60 vars in 1202 bytes} [Tue Oct 18 11:34:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:35:09.779281 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-cb941d74-df97-4063-aa8d-be5432ac8795 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:35:09.780233 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-cb941d74-df97-4063-aa8d-be5432ac8795 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Oct 18 11:35:09.780642 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 31/63] 10.222.0.17 () {54 vars in 931 bytes} [Tue Oct 18 11:35:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:35:09.791768 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:35:10.189855 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-a2b0d984-f438-4217-8ff0-05c66970a8c6 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:35:10.210540 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-a2b0d984-f438-4217-8ff0-05c66970a8c6 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.423192 Oct 18 11:35:10.211111 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 33/64] 10.222.0.17 () {60 vars in 1292 bytes} [Tue Oct 18 11:35:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:35:10.234426 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG dbcounter [-] [110435] Writing DB stats nova_api:SELECT=14 {{(pid=110435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:35:10.238157 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-c2e91aef-4dc2-497f-b5fc-cef0373f500d admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:35:10.245903 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-c2e91aef-4dc2-497f-b5fc-cef0373f500d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012904 Oct 18 11:35:10.246448 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 32/65] 10.222.0.17 () {60 vars in 1283 bytes} [Tue Oct 18 11:35:10 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:35:10.258492 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-c074d534-bee1-4578-adde-e274eb868a40 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:35:10.265987 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-c074d534-bee1-4578-adde-e274eb868a40 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011149 Oct 18 11:35:10.266527 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 34/66] 10.222.0.17 () {60 vars in 1286 bytes} [Tue Oct 18 11:35:10 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:35:10.279099 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-f921cc5a-286a-4b86-a636-8671b5d0ca73 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:35:10.286554 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-f921cc5a-286a-4b86-a636-8671b5d0ca73 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011122 Oct 18 11:35:10.287029 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 33/67] 10.222.0.17 () {60 vars in 1286 bytes} [Tue Oct 18 11:35:10 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:35:10.299529 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-f3b33381-2cf9-4624-a826-3ca9ef5aac32 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:35:10.306877 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-f3b33381-2cf9-4624-a826-3ca9ef5aac32 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010972 Oct 18 11:35:10.307402 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 35/68] 10.222.0.17 () {60 vars in 1283 bytes} [Tue Oct 18 11:35:10 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:38:19.758011 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-f921cc5a-286a-4b86-a636-8671b5d0ca73 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:38:19.759013 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-f921cc5a-286a-4b86-a636-8671b5d0ca73 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Oct 18 11:38:19.759405 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 34/69] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Oct 18 11:38:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:38:19.901820 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writing DB stats nova_api:SELECT=6 {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:38:20.066365 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-c607cbe2-082c-4ad2-956d-ff006a86a8ec admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:38:20.071221 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-c607cbe2-082c-4ad2-956d-ff006a86a8ec admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:38:20.071707 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-c607cbe2-082c-4ad2-956d-ff006a86a8ec admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:38:20.072144 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-c607cbe2-082c-4ad2-956d-ff006a86a8ec admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:38:20.072890 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-c607cbe2-082c-4ad2-956d-ff006a86a8ec admin admin] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:38:20.073451 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-c607cbe2-082c-4ad2-956d-ff006a86a8ec admin admin] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:38:20.073964 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-c607cbe2-082c-4ad2-956d-ff006a86a8ec admin admin] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:38:20.108148 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-c607cbe2-082c-4ad2-956d-ff006a86a8ec admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.207408 Oct 18 11:38:20.108722 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 36/70] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Oct 18 11:38:19 2022] GET /compute/v2.1/os-services => generated 794 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 11:38:21.202643 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-f921cc5a-286a-4b86-a636-8671b5d0ca73 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:38:21.203651 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-f921cc5a-286a-4b86-a636-8671b5d0ca73 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 18 11:38:21.204044 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 35/71] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Oct 18 11:38:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:38:21.397201 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-54dec903-853b-4612-973f-27dce9d79317 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:38:21.400636 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-54dec903-853b-4612-973f-27dce9d79317 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:38:21.401151 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-54dec903-853b-4612-973f-27dce9d79317 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:38:21.401607 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-54dec903-853b-4612-973f-27dce9d79317 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:38:21.402328 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-54dec903-853b-4612-973f-27dce9d79317 admin admin] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:38:21.402781 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-54dec903-853b-4612-973f-27dce9d79317 admin admin] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:38:21.403204 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-54dec903-853b-4612-973f-27dce9d79317 admin admin] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:38:21.423345 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-54dec903-853b-4612-973f-27dce9d79317 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.079840 Oct 18 11:38:21.423918 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 37/72] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Oct 18 11:38:21 2022] GET /compute/v2.1/os-services => generated 794 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 11:38:32.929315 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-f921cc5a-286a-4b86-a636-8671b5d0ca73 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:38:32.930322 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-f921cc5a-286a-4b86-a636-8671b5d0ca73 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 18 11:38:32.930719 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 36/73] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Oct 18 11:38:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:38:33.074996 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writing DB stats nova_cell0:SELECT=4 {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:38:33.075672 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writing DB stats nova_cell1:SELECT=4 {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:38:33.076259 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writing DB stats nova_api:SELECT=8 {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:38:33.124588 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-29e434a3-3336-4032-8d53-e5cef268c9b1 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:38:33.128549 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-29e434a3-3336-4032-8d53-e5cef268c9b1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:38:33.129077 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-29e434a3-3336-4032-8d53-e5cef268c9b1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:38:33.129543 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-29e434a3-3336-4032-8d53-e5cef268c9b1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:38:33.130259 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-29e434a3-3336-4032-8d53-e5cef268c9b1 admin admin] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:38:33.130705 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-29e434a3-3336-4032-8d53-e5cef268c9b1 admin admin] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:38:33.131124 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-29e434a3-3336-4032-8d53-e5cef268c9b1 admin admin] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:38:33.156242 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-29e434a3-3336-4032-8d53-e5cef268c9b1 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.085830 Oct 18 11:38:33.156799 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 38/74] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Oct 18 11:38:33 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:38:34.249221 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-f921cc5a-286a-4b86-a636-8671b5d0ca73 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:38:34.250257 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-f921cc5a-286a-4b86-a636-8671b5d0ca73 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Oct 18 11:38:34.250660 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 37/75] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Oct 18 11:38:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:38:34.443497 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-c5182cb0-90ad-401b-86ae-c550cd6ca359 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:38:34.446895 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-c5182cb0-90ad-401b-86ae-c550cd6ca359 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:38:34.447384 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-c5182cb0-90ad-401b-86ae-c550cd6ca359 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:38:34.447802 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-c5182cb0-90ad-401b-86ae-c550cd6ca359 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:38:34.448518 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-c5182cb0-90ad-401b-86ae-c550cd6ca359 admin admin] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:38:34.448996 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-c5182cb0-90ad-401b-86ae-c550cd6ca359 admin admin] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:38:34.449417 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-c5182cb0-90ad-401b-86ae-c550cd6ca359 admin admin] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:38:34.471526 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-c5182cb0-90ad-401b-86ae-c550cd6ca359 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.080516 Oct 18 11:38:34.472071 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 39/76] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Oct 18 11:38:34 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:39:33.760123 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: Tue Oct 18 11:39:33 2022 - graceful shutdown triggered... Oct 18 11:39:33.760257 dv-cinder-815582-17-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 18 11:39:33.766044 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: Gracefully killing worker 1 (pid: 110435)... Oct 18 11:39:33.766603 dv-cinder-815582-17-iscsi devstack@n-api.service[110436]: Gracefully killing worker 2 (pid: 110436)... Oct 18 11:39:33.888108 dv-cinder-815582-17-iscsi devstack@n-api.service[110435]: DEBUG dbcounter [-] [110435] Writing DB stats nova_api:SELECT=4 {{(pid=110435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:39:34.761815 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: worker 1 buried after 1 seconds Oct 18 11:39:34.761815 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: worker 2 buried after 1 seconds Oct 18 11:39:34.761815 dv-cinder-815582-17-iscsi devstack@n-api.service[110434]: goodbye to uWSGI. Oct 18 11:39:34.763446 dv-cinder-815582-17-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 18 11:39:34.764004 dv-cinder-815582-17-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 18 11:39:34.767290 dv-cinder-815582-17-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 18 11:39:34.776712 dv-cinder-815582-17-iscsi devstack@n-api.service[125471]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 18 11:39:34.778787 dv-cinder-815582-17-iscsi devstack@n-api.service[125471]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 18 11:39:34 2022] *** Oct 18 11:39:34.778787 dv-cinder-815582-17-iscsi devstack@n-api.service[125471]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 18 11:39:34.778787 dv-cinder-815582-17-iscsi devstack@n-api.service[125471]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 18 11:39:34.778787 dv-cinder-815582-17-iscsi devstack@n-api.service[125471]: nodename: dv-cinder-815582-17-iscsi Oct 18 11:39:34.778787 dv-cinder-815582-17-iscsi devstack@n-api.service[125471]: machine: x86_64 Oct 18 11:39:34.778787 dv-cinder-815582-17-iscsi devstack@n-api.service[125471]: clock source: unix Oct 18 11:39:34.778787 dv-cinder-815582-17-iscsi devstack@n-api.service[125471]: pcre jit disabled Oct 18 11:39:34.778787 dv-cinder-815582-17-iscsi devstack@n-api.service[125471]: detected number of CPU cores: 4 Oct 18 11:39:34.778787 dv-cinder-815582-17-iscsi devstack@n-api.service[125471]: current working directory: / Oct 18 11:39:34.778787 dv-cinder-815582-17-iscsi devstack@n-api.service[125471]: detected binary path: /usr/bin/uwsgi-core Oct 18 11:39:34.779472 dv-cinder-815582-17-iscsi devstack@n-api.service[125471]: your processes number limit is 47680 Oct 18 11:39:34.779472 dv-cinder-815582-17-iscsi devstack@n-api.service[125471]: your memory page size is 4096 bytes Oct 18 11:39:34.779472 dv-cinder-815582-17-iscsi devstack@n-api.service[125471]: detected max file descriptor number: 2048 Oct 18 11:39:34.779472 dv-cinder-815582-17-iscsi devstack@n-api.service[125471]: lock engine: pthread robust mutexes Oct 18 11:39:34.779472 dv-cinder-815582-17-iscsi devstack@n-api.service[125471]: thunder lock: enabled Oct 18 11:39:34.779472 dv-cinder-815582-17-iscsi devstack@n-api.service[125471]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 18 11:39:34.779472 dv-cinder-815582-17-iscsi devstack@n-api.service[125471]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 18 11:39:34.821156 dv-cinder-815582-17-iscsi devstack@n-api.service[125471]: Python main interpreter initialized at 0x561f774dd9c0 Oct 18 11:39:34.821156 dv-cinder-815582-17-iscsi devstack@n-api.service[125471]: python threads support enabled Oct 18 11:39:34.821156 dv-cinder-815582-17-iscsi devstack@n-api.service[125471]: your server socket listen backlog is limited to 100 connections Oct 18 11:39:34.821156 dv-cinder-815582-17-iscsi devstack@n-api.service[125471]: your mercy for graceful operations on workers is 90 seconds Oct 18 11:39:34.821608 dv-cinder-815582-17-iscsi devstack@n-api.service[125471]: mapped 403077 bytes (393 KB) for 2 cores Oct 18 11:39:34.821608 dv-cinder-815582-17-iscsi devstack@n-api.service[125471]: *** Operational MODE: preforking *** Oct 18 11:39:34.821756 dv-cinder-815582-17-iscsi devstack@n-api.service[125471]: *** uWSGI is running in multiple interpreter mode *** Oct 18 11:39:34.821756 dv-cinder-815582-17-iscsi devstack@n-api.service[125471]: spawned uWSGI master process (pid: 125471) Oct 18 11:39:34.822464 dv-cinder-815582-17-iscsi devstack@n-api.service[125471]: spawned uWSGI worker 1 (pid: 125485, cores: 1) Oct 18 11:39:34.822457 dv-cinder-815582-17-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 18 11:39:34.822818 dv-cinder-815582-17-iscsi devstack@n-api.service[125471]: spawned uWSGI worker 2 (pid: 125486, cores: 1) Oct 18 11:39:34.822980 dv-cinder-815582-17-iscsi devstack@n-api.service[125471]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 18 11:39:35.491325 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 18 11:39:35.495257 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 18 11:39:36.659619 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 11:39:36.659619 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: from cryptography.utils import int_from_bytes Oct 18 11:39:36.660255 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 11:39:36.660255 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: from cryptography.utils import int_from_bytes Oct 18 11:39:36.660677 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 11:39:36.660677 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: from cryptography.utils import int_from_bytes Oct 18 11:39:36.660805 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 11:39:36.660805 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: from cryptography.utils import int_from_bytes Oct 18 11:39:39.123731 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 18 11:39:39.124328 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 18 11:39:39.124608 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 18 11:39:39.124992 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 18 11:39:39.125240 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 18 11:39:39.125643 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.125976 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.126309 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.126802 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.127142 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.127463 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.127799 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.128130 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.128476 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.128748 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.129099 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.129436 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-17-iscsi {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.129775 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.130192 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.130435 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.130717 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.131019 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.131344 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.131661 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.132180 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.134341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.134341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.134341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.134341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.134341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.135084 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.135084 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.135340 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.135486 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.135942 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.136424 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-17-iscsi {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.136806 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.136806 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.137726 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.137726 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.138566 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.138566 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.138566 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.139609 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.141265 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 18 11:39:39.142475 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.142786 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 18 11:39:39.143051 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.143292 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 18 11:39:39.143688 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.143688 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.144213 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 18 11:39:39.144461 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.144795 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 18 11:39:39.145156 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.145409 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.145602 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.145824 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.146044 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.146217 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.147669 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.147669 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.147994 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.148153 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.148306 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.148460 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.148613 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.148758 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.148949 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.149107 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.149107 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.149387 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.149562 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.149741 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.149894 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.150047 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.150205 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.150351 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.150675 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.151160 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-17-iscsi {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.151330 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.151478 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.151632 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.151782 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.151963 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.152120 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.152322 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.153072 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.153239 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.153392 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.153547 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.153691 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.153840 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.153991 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.154135 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.154135 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.154488 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.154671 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.154819 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.154991 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.155135 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.155279 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.155439 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.155621 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.156366 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.156612 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.157541 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.157541 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.158013 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.158013 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.158461 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.158606 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.158808 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.158993 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.159197 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.159357 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.159501 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.159653 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.159832 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-17-iscsi {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.159986 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.160149 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.160308 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.160463 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.160612 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.160936 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.161165 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.161391 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.161624 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.161860 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.162081 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.162320 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.172638 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.172768 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.172878 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.172969 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.173065 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.173140 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.173217 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.173301 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.173380 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.173456 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.173547 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.173646 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.173727 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.173812 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.173812 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.173812 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.174039 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.174125 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.174210 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.174296 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.174373 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.174464 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.174542 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.174619 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.174703 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.174789 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.174868 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.174954 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.175059 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.175147 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.175231 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.175327 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.175418 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.175516 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.175603 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.175693 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.175785 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.175877 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.175978 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.176075 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.176171 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.176265 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.176351 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.176444 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.176444 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.176621 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.176713 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.176809 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.176929 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.177016 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.177114 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.177206 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.177291 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.177378 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.177472 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.177563 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.177655 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.177745 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.177836 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.177943 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.178030 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.178115 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.178199 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.178297 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.178391 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.178476 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.178561 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.178644 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.178739 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.178823 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.178923 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.179008 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.179085 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.179174 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.179268 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.179359 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.179456 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.179456 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.179620 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.179713 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.179713 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.179867 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.179964 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.180056 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.180141 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.180234 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.180319 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.180410 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.180506 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.180590 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.180668 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.180763 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.183929 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.184164 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.184323 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.184455 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.184589 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.184734 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.184938 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.185269 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.185506 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.185654 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.186125 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.186577 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.186857 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.188131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.188521 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.188521 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.189084 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.189349 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.189349 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.189829 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.190061 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.190308 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.190691 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.191097 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.191359 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.191603 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.193318 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.193318 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.193318 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.193318 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.193318 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.193318 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.193318 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.193318 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.195684 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.195934 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.196199 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.196605 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.197476 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.197719 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.197956 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.197956 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.198411 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.198670 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.199009 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.199176 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.199324 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.199477 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.199635 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.199863 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.200018 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.200172 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.200324 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.200469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.200613 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.200772 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.200952 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.201149 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.201294 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.201446 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.201446 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.201741 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.201886 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.202298 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.203513 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.203764 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.203954 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.204113 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.204266 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.204420 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.204564 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.204715 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.204942 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.205102 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.205260 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.205406 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.205594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.205594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.205594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.205594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.205594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.205594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.205594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.205594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.206687 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:39:39.206687 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.206687 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.206687 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.206687 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.206687 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.206687 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.206687 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.208723 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.208723 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.208723 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.208723 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.208723 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.208723 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.211022 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.211180 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.211325 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.211485 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.211485 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.211776 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.211928 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.212071 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.212496 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.212819 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.213222 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.214393 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.214557 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.214715 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.214870 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.215027 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.215179 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.215408 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.215570 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.215731 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.215878 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.216029 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.216180 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.216324 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.216479 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.216636 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.216789 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.216929 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.217043 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.217222 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.217368 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.217368 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.217708 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.218645 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.219054 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.219275 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.219677 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.219836 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.219990 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.220135 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.220280 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.220423 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.220575 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.220722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.220836 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.221048 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.221193 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.221344 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.221500 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.221656 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.221807 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.221977 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.222135 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.222279 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.222661 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.222814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.222959 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.223110 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.223496 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.223667 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.223814 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.223814 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.225947 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.226101 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.226261 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.226423 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.226569 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.226722 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.226875 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.227099 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.227253 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.227409 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.227563 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.227714 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.227862 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.228003 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.228453 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.228619 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.228765 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.228943 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.229092 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.229248 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.229392 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.229551 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.229696 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.229846 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.229997 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.230142 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.230305 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.230458 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.230458 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.230458 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.230458 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.230458 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.230458 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.230458 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.231447 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.231600 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.231758 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.231917 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.232158 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.232321 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.232465 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.232830 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.233017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.233017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.233017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.233017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.233017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.233017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.233017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.233017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.234768 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.235184 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.235344 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.235344 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.235630 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.235865 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.236018 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.236177 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.236335 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.236486 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.236635 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.236797 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.237003 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.237385 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.237555 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.237707 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.237858 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.238017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.238167 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.238606 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.238606 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.238606 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.238606 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.238606 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.238606 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.238606 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.238606 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.239753 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.240520 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.240684 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.240864 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.241037 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.241423 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.241576 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.241576 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.241576 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.241576 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.241576 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.241576 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.242462 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.242613 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.242613 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.243200 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.243353 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.243518 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.243518 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.244000 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.244000 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.244000 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.244000 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.244000 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.244000 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.245419 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.245580 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.245731 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.245881 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.246031 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.246190 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.246340 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.246499 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.246650 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.246800 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.246949 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.247122 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.247446 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.247619 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.247784 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.247934 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.248092 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.248242 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.248242 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.248242 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.248242 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.248242 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.249299 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.249459 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.249623 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.249783 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.249934 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.250091 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.250241 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.250400 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.250708 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.250868 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.251028 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.251186 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.251344 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.251505 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.251505 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.251505 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.251505 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.251505 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.252229 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.252433 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.252600 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.253027 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.253292 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.253448 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.253600 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.253916 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.254069 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.254413 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.254572 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.255059 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.255163 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.255250 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.255385 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.255474 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.255554 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.255641 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.255725 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.255818 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.255905 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.255988 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.256079 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.256172 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.256172 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.256172 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.256172 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.256491 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.256576 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.256659 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.256770 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.256910 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.257013 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.257101 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.257185 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.257269 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.257352 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.257352 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.257521 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.257614 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.257700 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.257791 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.257885 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.257978 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.258063 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.258156 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.258241 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.258325 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.258418 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.258504 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.258587 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.259043 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.259155 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.259243 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.259337 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.259431 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.259518 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.259602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.259695 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.259790 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.259889 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.260421 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.260525 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.260619 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.260781 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.260907 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.261055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.261154 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.261241 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.261332 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.261418 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.261510 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.261602 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.261688 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.261779 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.261864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.261954 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.262053 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.262146 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.262231 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.262315 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.262399 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.262506 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.262602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.262696 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.262782 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.262866 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.262950 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.263049 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.263143 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.263236 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.263594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.263683 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.263783 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.266368 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.266487 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.266583 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.266677 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.266770 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.266863 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.266958 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.267052 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.267145 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.267229 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.267323 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.267410 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.267507 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.267602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.267694 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.267788 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.267880 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.267970 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.267970 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.267970 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.268191 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.268275 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.268275 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.268443 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.268535 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.268620 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.268711 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.268795 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.268931 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.269044 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.269155 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.269242 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.269334 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.269419 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.269501 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.269592 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.269685 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.269776 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.269776 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.269928 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.270024 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.270127 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.270220 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.270307 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.270307 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.270307 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.270550 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.270651 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.270651 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.270822 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.270916 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.271010 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.271094 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.271177 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.271177 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.271347 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.271441 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.271526 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.271617 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.271711 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.271802 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.271899 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.271985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.272078 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.272078 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.272231 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.272325 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.272428 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.272514 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.272605 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.272689 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.272772 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.273282 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.273400 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.273512 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.273596 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.273682 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.273771 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.273871 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.273964 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.274049 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.274132 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.274223 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.274308 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.274406 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.274492 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.274575 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.274895 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.274986 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.275071 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.275166 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.275252 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.275344 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.275437 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.275609 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.275609 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.275805 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.275887 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.275960 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.276030 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.276113 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.276208 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.276301 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.276386 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.280359 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.280473 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.280624 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.281252 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.281327 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.281399 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.281469 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.281556 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.281638 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.281720 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.281793 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.281871 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.281953 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.282033 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.282105 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.282176 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.282176 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.282314 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.282394 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.282722 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.282807 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.282880 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.282959 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.283039 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.283125 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.283236 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.283236 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.285470 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.285565 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.285722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.285833 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.285971 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.286050 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.286122 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.286200 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.286360 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.286438 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.286516 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.286610 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.286693 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.286693 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.286839 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.286918 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.287004 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.287084 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.287175 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.287262 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.287343 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.287417 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.287561 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.287638 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.287728 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.287823 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.287918 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.288736 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.288829 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.288952 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.289046 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.289149 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.289236 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.289321 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.289413 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.289498 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.289590 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.289691 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.289778 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.289869 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.289955 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.290039 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.290122 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.290215 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.290215 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.290377 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.290470 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.290555 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.290646 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.290741 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.290828 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.290918 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.291398 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.291484 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.291579 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.291666 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.291752 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.291844 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.292301 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.292397 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.292498 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.292591 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.292677 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.292760 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.292923 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.293013 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.293113 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.293200 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.293283 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.293367 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.293452 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.293543 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.293638 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.293724 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.293807 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.293880 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.293958 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.294043 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.294124 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.294201 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.294292 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.294560 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.294560 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.294560 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.294560 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.295055 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.295055 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.295213 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.295317 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.295723 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.295834 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.295834 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.295834 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.295834 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.295834 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.295834 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.296707 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.296802 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.296802 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.296802 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.296802 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.296802 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.297184 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.297278 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.297376 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.297475 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.297562 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.297653 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.297653 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.297838 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.297925 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.297925 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.297925 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.297925 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.298223 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.298315 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.298408 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.298502 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.298588 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.298682 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.298784 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.298869 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.298961 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.299123 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.299211 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.299296 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.299380 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.299471 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.299570 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.299664 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.299759 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.299845 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.299845 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.299996 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.300089 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.300181 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.300266 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.300356 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.300441 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.300525 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.300617 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.300702 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.300786 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.301073 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.301180 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.301267 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.301361 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.301447 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.301530 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.301620 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.301715 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.301809 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.301896 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.301896 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.302048 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.302141 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.302234 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.302329 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.302426 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.302512 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.302596 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.302681 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.302763 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.302860 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.302954 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.303040 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.303131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.303224 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.303309 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.303469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.303469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.303625 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.303710 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.303793 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.303890 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.303979 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.304052 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.304135 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.304213 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.304283 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.304379 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.304473 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.304559 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.304643 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.304736 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.304829 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.304945 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.305043 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.305137 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.305225 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.305300 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.305383 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.305477 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.305715 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.305815 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.305890 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.305973 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.306085 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.306176 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.306250 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.306330 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.306402 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.306484 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.306577 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.306671 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.306757 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.306840 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.306930 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.307012 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.307093 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.307179 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.307270 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.307355 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.307439 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.307530 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.307634 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.307720 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.307812 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.307904 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.307989 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.308081 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.308174 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.308259 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.308351 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.308437 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.308521 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.308618 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.308718 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.308813 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.308913 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.309097 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.309197 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.309286 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.309368 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.309462 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.309555 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.309630 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.309713 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.309800 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.309887 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.310038 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.310129 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.310211 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.310294 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.310380 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.310464 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.310537 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.310627 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.310723 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.310831 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.310967 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.311070 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.311157 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.311230 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.311301 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.311399 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.311487 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.311580 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.311712 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.311843 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.311932 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.312020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.312093 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.312164 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.312243 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.312334 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.312424 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.312511 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.312596 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.312696 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.312696 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.312945 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.312945 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.313106 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.313191 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.313275 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.313275 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.313448 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.313551 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.313646 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.313733 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.313818 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.313915 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.314476 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.314577 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.314665 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.314758 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.314853 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.314949 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.315036 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.315121 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.315205 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.315296 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.315372 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.315372 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.315372 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.315688 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.315851 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.316044 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.316201 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.316375 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.316521 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.316621 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.316759 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.316922 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.317133 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.317271 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.317455 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.317580 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.317886 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.317982 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.318211 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.318317 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.318533 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.318642 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.318842 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.318942 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.319176 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.319270 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.319506 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.319606 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.319820 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.319955 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.320129 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.320262 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.320448 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.320621 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.320766 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.320929 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.321110 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.321252 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.321416 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.321550 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.321728 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.321896 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.322062 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.322242 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.322370 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.322485 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.322617 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.322759 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.322891 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.323029 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.323195 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.323338 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.323480 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.323709 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.323845 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.324045 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.324179 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.324365 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.324500 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.324684 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.324816 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.325025 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.325144 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.325311 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.325454 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.325619 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.325752 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.326042 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.326178 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.326315 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.326454 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.326567 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.326696 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.326867 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.327044 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.327211 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.327339 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.328018 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.328146 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.328327 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.328446 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.328645 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.328763 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.329006 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.329126 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.329331 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.329474 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.329649 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.329817 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.329953 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.330133 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.330266 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.330467 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.330611 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.330793 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.330926 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.331124 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.331266 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.331453 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.331601 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.331765 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.332040 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.332179 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.332367 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.332514 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.332668 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.337025 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.337752 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.337890 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.337890 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.338138 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.338138 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.340017 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.340246 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.340374 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.340506 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.340654 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.340802 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.341078 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.341227 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.341349 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.341494 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.341634 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.341762 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.341874 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.341986 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.342115 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.342227 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.342362 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.342491 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.342626 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.342756 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.342902 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.343063 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.343693 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.344069 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.344187 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.344304 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.344441 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.344571 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.344702 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.344859 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.345043 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.345287 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.345422 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.345545 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.345672 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.345810 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.345940 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.346082 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.346265 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.346397 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.346536 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.346536 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.346799 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.346940 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.347069 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.347206 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.347360 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.347497 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.347913 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.348069 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.348210 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.349646 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.349791 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.349937 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.350082 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.350222 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.350360 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.350490 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.350611 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.350742 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.350874 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.350874 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.351096 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.351206 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.351334 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.351472 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.351611 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.351740 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.351869 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.351997 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.352134 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.352278 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.352415 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.352633 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.352755 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.352918 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.353051 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.353193 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.353324 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.353462 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.353597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.353597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.353812 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.354008 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.354130 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.354242 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.356459 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.356629 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.356769 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.356769 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.357037 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.357152 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.357286 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.357454 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.357636 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.357898 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.358176 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.358302 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.358454 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.358594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.358820 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.358970 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.359093 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.359213 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.359347 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.359469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.359624 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.359744 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.359869 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.360071 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.360185 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.360358 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.360498 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.360617 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.360742 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.360901 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.361053 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.361196 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.361327 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.361458 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.361589 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.361726 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.361857 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.361996 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.362127 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.362257 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.362387 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.362524 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.362790 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.362937 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.363070 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.363209 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.363346 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.363484 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.363624 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.363764 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.363895 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.364024 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.364143 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.364256 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.364393 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.364533 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.364652 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.364771 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.364999 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.365131 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.365280 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.365419 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.365549 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.365687 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.365827 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.366633 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.366785 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.366926 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.367058 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.367188 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.367326 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.367472 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.367610 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.367730 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.367854 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.367983 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.368114 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.368253 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.368384 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.368521 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.368660 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.368791 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.369003 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.369136 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.369536 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.369675 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.369805 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.369995 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.369995 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.370297 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.371788 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.372438 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.372561 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.372907 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.373071 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.373196 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.373348 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.373348 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.373602 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.373730 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.373916 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.374070 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.374215 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.374215 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.374489 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.374489 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.374740 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.374740 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.374993 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.375124 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.375269 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.375407 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.375537 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.375666 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.375795 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.375926 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.376066 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.376196 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.376316 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.376453 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.376583 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.376583 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.376950 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.377084 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.377214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.377346 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.377484 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.377632 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.377771 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.377907 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.378039 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.378176 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.378317 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.378457 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.378588 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.378717 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.378846 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.379327 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.379480 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.379633 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.379762 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.379895 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.380025 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.380155 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.380293 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.380425 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.380555 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.380684 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.380813 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.380955 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.381082 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.381203 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.381325 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.381464 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.381596 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.381733 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.381873 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.381987 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.382327 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.382455 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.382568 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.382680 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.382827 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.382966 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.383086 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.383204 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.383330 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.383461 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.383601 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.383738 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.383876 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.384020 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.384142 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.384288 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.384420 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.384549 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.384723 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.384889 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.385022 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.385232 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.385371 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.385371 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.385633 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.385761 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.385904 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.386044 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.386174 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.386310 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.386447 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.386577 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.386768 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.386903 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.387033 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.387170 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.387299 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.387429 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.387567 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.387703 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.387841 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.388017 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.388195 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.388329 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.388467 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.388598 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.388728 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.388883 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.389015 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.389159 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.389290 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.389426 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.389547 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.389547 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.389831 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.390479 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.390610 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.390739 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.390868 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.390998 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.391125 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.391252 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.391377 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.391506 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.391635 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.391771 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.391910 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.392051 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.392190 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.392327 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.392465 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.392595 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.392741 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.392920 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.393055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.393184 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.393322 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.393450 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.393592 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.393724 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.393724 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.393984 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.394115 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.394251 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.394390 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.394521 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.394658 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.394787 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.394923 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.395061 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.395192 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.395330 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.395460 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.395589 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.395727 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.395866 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.396051 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.396172 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.396389 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.397118 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.397259 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.397407 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.397545 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.397685 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.397816 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.397954 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.398085 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.398224 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.398365 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.398504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.398636 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.398774 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.398977 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.399160 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.399295 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.399421 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.399551 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.399689 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.399834 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.400004 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.400185 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.400310 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.400430 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.400558 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.400700 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.400899 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.401032 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.401174 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.401304 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.401304 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.401560 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.401688 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.401826 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.401956 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.402099 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.402258 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.402397 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.402536 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.402670 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.402808 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.402980 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.403359 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.403644 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.403780 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.403920 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.404057 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.404202 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.404332 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.404462 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.404600 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.404720 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.404870 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.405017 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.405155 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.405292 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.405429 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.406179 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.406327 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.406475 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.406607 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.406745 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.406883 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.407020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.407200 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.407342 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.407473 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.407607 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.407738 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.407875 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.408018 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.408157 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.408294 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.408432 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.408573 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.408712 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.408901 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.409034 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.409176 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.409307 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.409443 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.409573 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.409713 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.409858 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.409996 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.410135 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.410271 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.410416 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.410554 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.410690 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.410830 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.410970 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.411101 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.411245 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.411375 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.411504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.411641 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.411771 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.411903 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.412042 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.412174 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 18 11:39:39.412313 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.412313 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.412313 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.412313 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.412313 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.412313 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.412313 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.412313 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.413409 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.413409 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.413409 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.413409 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.413409 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.413409 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.413409 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.413409 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.414366 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.414366 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.414366 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.414366 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.414366 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.414366 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.414366 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.414366 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.415337 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.415337 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.415337 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.415337 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.415337 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.415337 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.415337 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.415337 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.416298 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.416298 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.416298 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.416298 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.416743 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.417086 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.417408 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.417729 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.418058 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.418386 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.418718 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.419049 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.419367 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.419829 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.420039 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.420399 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.420805 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.421420 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.421565 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.421786 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.422081 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.422393 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:39:39.422642 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 18 11:39:39.465812 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO dbcounter [None req-5e6a8d96-5f73-43fb-9721-1195fc692848 None None] Registered counter for database nova_api Oct 18 11:39:39.484730 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO dbcounter [None req-9891b353-de41-4658-857d-71201e0281f8 None None] Registered counter for database nova_api Oct 18 11:39:39.487477 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_db.sqlalchemy.engines [None req-5e6a8d96-5f73-43fb-9721-1195fc692848 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125486) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 11:39:39.494417 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writer thread running {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 11:39:39.505822 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_db.sqlalchemy.engines [None req-9891b353-de41-4658-857d-71201e0281f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125485) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 11:39:39.512637 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writer thread running {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 11:39:39.551108 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.context [None req-5e6a8d96-5f73-43fb-9721-1195fc692848 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7aca09e1-1559-4e39-9509-e923bbe1e225(cell1) {{(pid=125486) load_cells /opt/stack/nova/nova/context.py:464}} Oct 18 11:39:39.555128 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5e6a8d96-5f73-43fb-9721-1195fc692848 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:39:39.555596 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5e6a8d96-5f73-43fb-9721-1195fc692848 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:39:39.557216 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5e6a8d96-5f73-43fb-9721-1195fc692848 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:39:39.557946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5e6a8d96-5f73-43fb-9721-1195fc692848 None None] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:39:39.558391 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5e6a8d96-5f73-43fb-9721-1195fc692848 None None] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:39:39.560393 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5e6a8d96-5f73-43fb-9721-1195fc692848 None None] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:39:39.562520 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO dbcounter [None req-5e6a8d96-5f73-43fb-9721-1195fc692848 None None] Registered counter for database nova_cell0 Oct 18 11:39:39.566538 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO dbcounter [None req-5e6a8d96-5f73-43fb-9721-1195fc692848 None None] Registered counter for database nova_cell1 Oct 18 11:39:39.569588 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.context [None req-9891b353-de41-4658-857d-71201e0281f8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7aca09e1-1559-4e39-9509-e923bbe1e225(cell1) {{(pid=125485) load_cells /opt/stack/nova/nova/context.py:464}} Oct 18 11:39:39.574851 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9891b353-de41-4658-857d-71201e0281f8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:39:39.575069 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_db.sqlalchemy.engines [None req-5e6a8d96-5f73-43fb-9721-1195fc692848 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125486) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 11:39:39.575162 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9891b353-de41-4658-857d-71201e0281f8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:39:39.575450 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_db.sqlalchemy.engines [None req-5e6a8d96-5f73-43fb-9721-1195fc692848 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125486) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 11:39:39.575810 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9891b353-de41-4658-857d-71201e0281f8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:39:39.576568 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9891b353-de41-4658-857d-71201e0281f8 None None] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:39:39.577047 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9891b353-de41-4658-857d-71201e0281f8 None None] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:39:39.579130 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9891b353-de41-4658-857d-71201e0281f8 None None] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:39:39.581186 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO dbcounter [None req-9891b353-de41-4658-857d-71201e0281f8 None None] Registered counter for database nova_cell0 Oct 18 11:39:39.582129 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writer thread running {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 11:39:39.583446 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writer thread running {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 11:39:39.585344 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO dbcounter [None req-9891b353-de41-4658-857d-71201e0281f8 None None] Registered counter for database nova_cell1 Oct 18 11:39:39.592393 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_db.sqlalchemy.engines [None req-9891b353-de41-4658-857d-71201e0281f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125485) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 11:39:39.595620 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_db.sqlalchemy.engines [None req-9891b353-de41-4658-857d-71201e0281f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125485) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 11:39:39.603201 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writer thread running {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 11:39:39.603532 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writer thread running {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 11:39:39.734815 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO dbcounter [None req-5e6a8d96-5f73-43fb-9721-1195fc692848 None None] Registered counter for database nova_cell0 Oct 18 11:39:39.741961 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_db.sqlalchemy.engines [None req-5e6a8d96-5f73-43fb-9721-1195fc692848 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125486) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 11:39:39.746772 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writer thread running {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 11:39:39.761062 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO dbcounter [None req-9891b353-de41-4658-857d-71201e0281f8 None None] Registered counter for database nova_cell0 Oct 18 11:39:39.767988 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_db.sqlalchemy.engines [None req-9891b353-de41-4658-857d-71201e0281f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125485) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 11:39:39.772569 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writer thread running {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 11:39:40.074081 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: WARNING keystonemiddleware.auth_token [None req-5e6a8d96-5f73-43fb-9721-1195fc692848 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 11:39:40.081998 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: WARNING keystonemiddleware.auth_token [None req-5e6a8d96-5f73-43fb-9721-1195fc692848 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 11:39:40.104661 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: WARNING keystonemiddleware.auth_token [None req-9891b353-de41-4658-857d-71201e0281f8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 11:39:40.112593 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: WARNING keystonemiddleware.auth_token [None req-9891b353-de41-4658-857d-71201e0281f8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 11:39:40.435837 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: WARNING keystonemiddleware.auth_token [None req-5e6a8d96-5f73-43fb-9721-1195fc692848 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 11:39:40.442555 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: WARNING keystonemiddleware.auth_token [None req-5e6a8d96-5f73-43fb-9721-1195fc692848 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 11:39:40.447914 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561f774dd9c0 pid: 125486 (default app) Oct 18 11:39:40.462555 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: WARNING keystonemiddleware.auth_token [None req-9891b353-de41-4658-857d-71201e0281f8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 11:39:40.469458 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: WARNING keystonemiddleware.auth_token [None req-9891b353-de41-4658-857d-71201e0281f8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 11:39:40.474864 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561f774dd9c0 pid: 125485 (default app) Oct 18 11:40:16.991833 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_api:SELECT=3 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:40:16.992989 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell0:SELECT=3 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:40:16.993729 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell1:SELECT=3 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:40:16.997357 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell0:SELECT=3 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:40:17.976792 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_api:SELECT=3 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:40:17.978285 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell0:SELECT=3 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:40:17.979224 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=3 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:40:17.981184 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell0:SELECT=3 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:40:18.490145 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-b6567dd8-6d77-4da7-9dbe-ef6b4ffae2a4 tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] Action: 'create', calling method: .version_select at 0x7f4be0fa3b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1092003292"}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:40:19.164978 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-5998a0d7-ab85-436c-8ffa-13062ffd5ae1 tempest-VolumesNegativeTest-124437624 tempest-VolumesNegativeTest-124437624-project] Action: 'create', calling method: .version_select at 0x7f4be0fa2b80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-722055275", "metadata": {"Type": "work"}}} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:40:19.203909 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-5998a0d7-ab85-436c-8ffa-13062ffd5ae1 tempest-VolumesNegativeTest-124437624 tempest-VolumesNegativeTest-124437624-project] Request method failure captured: Oct 18 11:40:19.203909 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 18 11:40:19.203909 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:40:19.203909 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:40:19.203909 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:40:19.203909 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 121 Oct 18 11:40:19.203909 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:40:19.203909 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:40:19.203909 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:40:19.203909 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:40:19.203909 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpCh6j4e2KmAbwVG0B9HqskCXWCkoAixvohy78I3evZ-VFZxTVobjo-3IAstf4sAtAFaxQRiTVN_WnYB-VQx9sI-Ts9_3ywWN0c5d3n5J0sxNJPOo7a3E4bNVZVb6jj3HcqwKWH8Hw235HZXC_oaFxBwNGGZnrDdIcpgYktPwET1XqE Oct 18 11:40:19.203909 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:40:19.203909 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:40:19.203909 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:40:19.203909 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:40:19.203909 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:40:19.203909 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:40:19.203909 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: 9b20565451464b3f8e227b1804e9fb92 Oct 18 11:40:19.203909 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-VolumesNegativeTest-124437624 Oct 18 11:40:19.203909 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:40:19.203909 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:40:19.205682 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9b20565451464b3f8e227b1804e9fb92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9b20565451464b3f8e227b1804e9fb92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9b20565451464b3f8e227b1804e9fb92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9b20565451464b3f8e227b1804e9fb92"}]}] Oct 18 11:40:19.205682 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-VolumesNegativeTest-124437624 Oct 18 11:40:19.205682 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: 9b20565451464b3f8e227b1804e9fb92 Oct 18 11:40:19.205682 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-VolumesNegativeTest-124437624 Oct 18 11:40:19.205682 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-VolumesNegativeTest-124437624-project Oct 18 11:40:19.205682 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:40:19.205682 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:40:19.205682 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: 8fe6229212e4411fb2f617a7a49a570d Oct 18 11:40:19.205682 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-VolumesNegativeTest-124437624-project Oct 18 11:40:19.205682 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Oct 18 11:40:19.205682 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-722055275", "metadata": {"Type": "work"}}} Oct 18 11:40:19.205682 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: Oct 18 11:40:19.205682 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 18 11:40:19.206655 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-722055275', 'metadata': {'Type': 'work'}}}} Oct 18 11:40:19.206655 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:40:19.206655 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:19.206655 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 11:40:19.206655 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 11:40:19.206655 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 11:40:19.206655 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise error Oct 18 11:40:19.206655 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 18 11:40:19.206655 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:19.206655 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 18 11:40:19.206655 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 18 11:40:19.206655 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:19.206655 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 18 11:40:19.206655 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi '#$%' Oct 18 11:40:19.206655 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:19.206655 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:40:19.206655 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:19.206655 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:19.206655 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:40:19.206655 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:40:19.206655 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:40:19.206655 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:40:19.208257 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 11:40:19.208257 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 11:40:19.208257 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:40:19.208257 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:40:19.208257 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 11:40:19.208257 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 11:40:19.208257 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 11:40:19.208257 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 11:40:19.208257 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 11:40:19.208257 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 11:40:19.208257 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 18 11:40:19.208257 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:19.208257 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:40:19.208257 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:19.208257 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:19.208257 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:40:19.208257 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:40:19.208257 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 11:40:19.208257 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 11:40:19.209647 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 18 11:40:19.209647 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:19.218157 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-5998a0d7-ab85-436c-8ffa-13062ffd5ae1 tempest-VolumesNegativeTest-124437624 tempest-VolumesNegativeTest-124437624-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:40:19.221915 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-5998a0d7-ab85-436c-8ffa-13062ffd5ae1 tempest-VolumesNegativeTest-124437624 tempest-VolumesNegativeTest-124437624-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.250199 Oct 18 11:40:19.223252 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 1/1] 10.222.0.17 () {60 vars in 1156 bytes} [Tue Oct 18 11:40:17 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1254 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 11:40:19.249626 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-84fd5d70-2237-4938-a490-080f9ad2b20f tempest-VolumesNegativeTest-124437624 tempest-VolumesNegativeTest-124437624-project] Action: 'create', calling method: .version_select at 0x7f4be0fba430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-615198340", "metadata": {"Type": "work"}}} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:40:19.260285 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-84fd5d70-2237-4938-a490-080f9ad2b20f tempest-VolumesNegativeTest-124437624 tempest-VolumesNegativeTest-124437624-project] Request method failure captured: Oct 18 11:40:19.260285 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 18 11:40:19.260285 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:40:19.260285 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:40:19.260285 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:40:19.260285 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 119 Oct 18 11:40:19.260285 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:40:19.260285 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:40:19.260285 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:40:19.260285 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:40:19.260285 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpCh6j4e2KmAbwVG0B9HqskCXWCkoAixvohy78I3evZ-VFZxTVobjo-3IAstf4sAtAFaxQRiTVN_WnYB-VQx9sI-Ts9_3ywWN0c5d3n5J0sxNJPOo7a3E4bNVZVb6jj3HcqwKWH8Hw235HZXC_oaFxBwNGGZnrDdIcpgYktPwET1XqE Oct 18 11:40:19.260285 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:40:19.260285 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:40:19.260285 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:40:19.260285 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:40:19.260285 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:40:19.260285 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:40:19.260285 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: 9b20565451464b3f8e227b1804e9fb92 Oct 18 11:40:19.260285 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-VolumesNegativeTest-124437624 Oct 18 11:40:19.260285 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:40:19.260285 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:40:19.261610 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9b20565451464b3f8e227b1804e9fb92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9b20565451464b3f8e227b1804e9fb92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9b20565451464b3f8e227b1804e9fb92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9b20565451464b3f8e227b1804e9fb92"}]}] Oct 18 11:40:19.261610 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-VolumesNegativeTest-124437624 Oct 18 11:40:19.261610 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: 9b20565451464b3f8e227b1804e9fb92 Oct 18 11:40:19.261610 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-VolumesNegativeTest-124437624 Oct 18 11:40:19.261610 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-VolumesNegativeTest-124437624-project Oct 18 11:40:19.261610 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:40:19.261610 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:40:19.261610 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: 8fe6229212e4411fb2f617a7a49a570d Oct 18 11:40:19.261610 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-VolumesNegativeTest-124437624-project Oct 18 11:40:19.261610 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Oct 18 11:40:19.261610 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-615198340", "metadata": {"Type": "work"}}} Oct 18 11:40:19.261610 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: Oct 18 11:40:19.261610 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 18 11:40:19.262416 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-615198340', 'metadata': {'Type': 'work'}}}} Oct 18 11:40:19.262416 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:40:19.262416 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:19.262416 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 11:40:19.262416 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 11:40:19.262416 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 11:40:19.262416 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise error Oct 18 11:40:19.262416 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 18 11:40:19.262416 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:19.262416 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 18 11:40:19.262416 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 18 11:40:19.262416 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:19.262416 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 18 11:40:19.262416 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi '0' Oct 18 11:40:19.262416 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:19.262416 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:40:19.262416 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:19.262416 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:19.262416 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:40:19.262416 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:40:19.262416 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:40:19.262416 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:40:19.263756 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 11:40:19.263756 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 11:40:19.263756 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:40:19.263756 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:40:19.263756 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 11:40:19.263756 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 11:40:19.263756 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 11:40:19.263756 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 11:40:19.263756 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 11:40:19.263756 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 11:40:19.263756 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 18 11:40:19.263756 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:19.263756 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:40:19.263756 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:19.263756 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:19.263756 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:40:19.263756 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:40:19.263756 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 11:40:19.263756 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 11:40:19.266012 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 18 11:40:19.266012 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:19.266012 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-84fd5d70-2237-4938-a490-080f9ad2b20f tempest-VolumesNegativeTest-124437624 tempest-VolumesNegativeTest-124437624-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:40:19.266012 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-84fd5d70-2237-4938-a490-080f9ad2b20f tempest-VolumesNegativeTest-124437624 tempest-VolumesNegativeTest-124437624-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.029783 Oct 18 11:40:19.271386 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 2/2] 10.222.0.17 () {60 vars in 1156 bytes} [Tue Oct 18 11:40:19 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 11:40:19.283030 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-5a2be8aa-4340-4cf8-8fec-1f62c2b6084e tempest-VolumesNegativeTest-124437624 tempest-VolumesNegativeTest-124437624-project] Action: 'create', calling method: .version_select at 0x7f4be0e5e820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1241150712", "metadata": {"Type": "work"}}} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:40:19.297898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-5a2be8aa-4340-4cf8-8fec-1f62c2b6084e tempest-VolumesNegativeTest-124437624 tempest-VolumesNegativeTest-124437624-project] Request method failure captured: Oct 18 11:40:19.297898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 18 11:40:19.297898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:40:19.297898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:40:19.297898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:40:19.297898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 119 Oct 18 11:40:19.297898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:40:19.297898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:40:19.297898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:40:19.297898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:40:19.297898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpCh6j4e2KmAbwVG0B9HqskCXWCkoAixvohy78I3evZ-VFZxTVobjo-3IAstf4sAtAFaxQRiTVN_WnYB-VQx9sI-Ts9_3ywWN0c5d3n5J0sxNJPOo7a3E4bNVZVb6jj3HcqwKWH8Hw235HZXC_oaFxBwNGGZnrDdIcpgYktPwET1XqE Oct 18 11:40:19.297898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:40:19.297898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:40:19.297898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:40:19.297898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:40:19.297898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:40:19.297898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:40:19.297898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: 9b20565451464b3f8e227b1804e9fb92 Oct 18 11:40:19.297898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-VolumesNegativeTest-124437624 Oct 18 11:40:19.297898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:40:19.297898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:40:19.299335 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9b20565451464b3f8e227b1804e9fb92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9b20565451464b3f8e227b1804e9fb92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9b20565451464b3f8e227b1804e9fb92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9b20565451464b3f8e227b1804e9fb92"}]}] Oct 18 11:40:19.299335 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-VolumesNegativeTest-124437624 Oct 18 11:40:19.299335 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: 9b20565451464b3f8e227b1804e9fb92 Oct 18 11:40:19.299335 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-VolumesNegativeTest-124437624 Oct 18 11:40:19.299335 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-VolumesNegativeTest-124437624-project Oct 18 11:40:19.299335 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:40:19.299335 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:40:19.299335 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: 8fe6229212e4411fb2f617a7a49a570d Oct 18 11:40:19.299335 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-VolumesNegativeTest-124437624-project Oct 18 11:40:19.299335 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Oct 18 11:40:19.299335 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1241150712", "metadata": {"Type": "work"}}} Oct 18 11:40:19.299335 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: Oct 18 11:40:19.299335 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 18 11:40:19.300214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1241150712', 'metadata': {'Type': 'work'}}}} Oct 18 11:40:19.300214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:40:19.300214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:19.300214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 11:40:19.300214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 11:40:19.300214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 11:40:19.300214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise error Oct 18 11:40:19.300214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 18 11:40:19.300214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:19.300214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 18 11:40:19.300214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 18 11:40:19.300214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:19.300214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 18 11:40:19.300214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi '' Oct 18 11:40:19.300214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:19.300214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:40:19.300214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:19.300214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:19.300214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:40:19.300214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:40:19.300214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:40:19.300214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:40:19.301480 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 11:40:19.301480 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 11:40:19.301480 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:40:19.301480 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:40:19.301480 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 11:40:19.301480 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 11:40:19.301480 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 11:40:19.301480 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 11:40:19.301480 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 11:40:19.301480 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 11:40:19.301480 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 18 11:40:19.301480 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:19.301480 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:40:19.301480 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:19.301480 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:19.301480 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:40:19.301480 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:40:19.301480 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 11:40:19.301480 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 11:40:19.302529 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 18 11:40:19.302529 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:19.302529 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-5a2be8aa-4340-4cf8-8fec-1f62c2b6084e tempest-VolumesNegativeTest-124437624 tempest-VolumesNegativeTest-124437624-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:40:19.302529 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-5a2be8aa-4340-4cf8-8fec-1f62c2b6084e tempest-VolumesNegativeTest-124437624 tempest-VolumesNegativeTest-124437624-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.028167 Oct 18 11:40:19.307002 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 3/3] 10.222.0.17 () {60 vars in 1156 bytes} [Tue Oct 18 11:40:19 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 11:40:19.313951 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-90788a70-3898-4bd3-9583-473b07018638 tempest-VolumesNegativeTest-124437624 tempest-VolumesNegativeTest-124437624-project] Calling method '.version_select at 0x7f4be0e5e280>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:19.840113 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.wsgi [None req-90788a70-3898-4bd3-9583-473b07018638 tempest-VolumesNegativeTest-124437624 tempest-VolumesNegativeTest-124437624-project] HTTP exception thrown: Volume tempest-invalid-710343642 could not be found. Oct 18 11:40:19.845693 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-90788a70-3898-4bd3-9583-473b07018638 tempest-VolumesNegativeTest-124437624 tempest-VolumesNegativeTest-124437624-project] Request method failure captured: Oct 18 11:40:19.845693 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-710343642 HTTP/1.1 Oct 18 11:40:19.845693 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:40:19.845693 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:40:19.845693 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:40:19.845693 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 0 Oct 18 11:40:19.845693 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:40:19.845693 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:40:19.845693 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:40:19.845693 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:40:19.845693 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpCh6j4e2KmAbwVG0B9HqskCXWCkoAixvohy78I3evZ-VFZxTVobjo-3IAstf4sAtAFaxQRiTVN_WnYB-VQx9sI-Ts9_3ywWN0c5d3n5J0sxNJPOo7a3E4bNVZVb6jj3HcqwKWH8Hw235HZXC_oaFxBwNGGZnrDdIcpgYktPwET1XqE Oct 18 11:40:19.845693 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:40:19.845693 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:40:19.845693 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:40:19.845693 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:40:19.845693 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:40:19.845693 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:40:19.845693 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: 9b20565451464b3f8e227b1804e9fb92 Oct 18 11:40:19.845693 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-VolumesNegativeTest-124437624 Oct 18 11:40:19.845693 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:40:19.845693 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:40:19.847290 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9b20565451464b3f8e227b1804e9fb92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9b20565451464b3f8e227b1804e9fb92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9b20565451464b3f8e227b1804e9fb92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9b20565451464b3f8e227b1804e9fb92"}]}] Oct 18 11:40:19.847290 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-VolumesNegativeTest-124437624 Oct 18 11:40:19.847290 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: 9b20565451464b3f8e227b1804e9fb92 Oct 18 11:40:19.847290 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-VolumesNegativeTest-124437624 Oct 18 11:40:19.847290 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-VolumesNegativeTest-124437624-project Oct 18 11:40:19.847290 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:40:19.847290 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:40:19.847290 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: 8fe6229212e4411fb2f617a7a49a570d Oct 18 11:40:19.847290 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-VolumesNegativeTest-124437624-project Oct 18 11:40:19.847290 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: Oct 18 11:40:19.847290 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Volume tempest-invalid-710343642 could not be found. Oct 18 11:40:19.847290 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'id': 'tempest-invalid-710343642'} Oct 18 11:40:19.847290 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:40:19.848243 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:19.848243 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 11:40:19.848243 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 11:40:19.848243 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 18 11:40:19.848243 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 18 11:40:19.848243 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 18 11:40:19.848243 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 18 11:40:19.848243 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 18 11:40:19.848243 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 18 11:40:19.848243 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 18 11:40:19.848243 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 18 11:40:19.848243 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 11:40:19.848243 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 11:40:19.848243 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 11:40:19.848243 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 11:40:19.848243 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-710343642 could not be found. (HTTP 404) (Request-ID: req-0a2744b9-668f-4290-b1c9-ed585ec564a7) Oct 18 11:40:19.848243 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:19.848243 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:40:19.848243 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:19.849627 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:19.849627 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 18 11:40:19.849627 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 18 11:40:19.849627 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 11:40:19.849627 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 11:40:19.849627 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 11:40:19.849627 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 11:40:19.849627 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 11:40:19.849627 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 11:40:19.849627 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 11:40:19.849627 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 11:40:19.849627 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 18 11:40:19.849627 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 18 11:40:19.849627 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 18 11:40:19.849627 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 18 11:40:19.849627 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 18 11:40:19.849627 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 18 11:40:19.849627 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 18 11:40:19.849627 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 18 11:40:19.850967 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 11:40:19.850967 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 11:40:19.850967 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 11:40:19.850967 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 11:40:19.850967 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-710343642 could not be found. Oct 18 11:40:19.850967 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:19.850967 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:40:19.850967 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:19.850967 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:19.850967 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:40:19.850967 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:40:19.850967 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:40:19.850967 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:40:19.850967 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 11:40:19.850967 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 11:40:19.850967 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:40:19.850967 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:40:19.850967 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 18 11:40:19.850967 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:40:19.850967 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-710343642 could not be found. Oct 18 11:40:19.852346 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:19.852346 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:40:19.852346 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:19.852346 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:19.852346 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:40:19.852346 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:40:19.852346 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:40:19.852346 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:40:19.852346 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-710343642 could not be found. Oct 18 11:40:19.852346 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:19.854003 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-90788a70-3898-4bd3-9583-473b07018638 tempest-VolumesNegativeTest-124437624 tempest-VolumesNegativeTest-124437624-project] Returning 404 to user: Volume tempest-invalid-710343642 could not be found. {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:40:19.857529 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-90788a70-3898-4bd3-9583-473b07018638 tempest-VolumesNegativeTest-124437624 tempest-VolumesNegativeTest-124437624-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-710343642" status: 404 len: 98 microversion: 2.1 time: 0.546371 Oct 18 11:40:19.861816 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 4/4] 10.222.0.17 () {58 vars in 1215 bytes} [Tue Oct 18 11:40:19 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-710343642 => generated 98 bytes in 554 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 11:40:19.893783 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-67f69e22-aa7c-455e-b1a2-118591779b04 tempest-VolumesNegativeTest-124437624 tempest-VolumesNegativeTest-124437624-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.021751 Oct 18 11:40:19.894902 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 5/5] 10.222.0.17 () {58 vars in 1140 bytes} [Tue Oct 18 11:40:19 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 18 11:40:19.906686 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-81db421a-9ff6-4f56-9acd-fc88907a54ad tempest-VolumesNegativeTest-124437624 tempest-VolumesNegativeTest-124437624-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004993 Oct 18 11:40:19.907532 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 6/6] 10.222.0.17 () {58 vars in 1137 bytes} [Tue Oct 18 11:40:19 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 18 11:40:19.919366 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ad687fd7-ae2c-41da-a49e-cccdcb19a416 tempest-VolumesNegativeTest-124437624 tempest-VolumesNegativeTest-124437624-project] Calling method '.version_select at 0x7f4be0e38dc0>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:20.137029 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.wsgi [None req-ad687fd7-ae2c-41da-a49e-cccdcb19a416 tempest-VolumesNegativeTest-124437624 tempest-VolumesNegativeTest-124437624-project] HTTP exception thrown: Volume cf775e1f-07b5-495e-8076-991fa8bbbb62 could not be found. Oct 18 11:40:20.139837 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ad687fd7-ae2c-41da-a49e-cccdcb19a416 tempest-VolumesNegativeTest-124437624 tempest-VolumesNegativeTest-124437624-project] Request method failure captured: Oct 18 11:40:20.139837 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: DELETE /compute/v2.1/os-volumes/cf775e1f-07b5-495e-8076-991fa8bbbb62 HTTP/1.1 Oct 18 11:40:20.139837 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:40:20.139837 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:40:20.139837 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:40:20.139837 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 0 Oct 18 11:40:20.139837 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:40:20.139837 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:40:20.139837 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:40:20.139837 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:40:20.139837 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpCh6j4e2KmAbwVG0B9HqskCXWCkoAixvohy78I3evZ-VFZxTVobjo-3IAstf4sAtAFaxQRiTVN_WnYB-VQx9sI-Ts9_3ywWN0c5d3n5J0sxNJPOo7a3E4bNVZVb6jj3HcqwKWH8Hw235HZXC_oaFxBwNGGZnrDdIcpgYktPwET1XqE Oct 18 11:40:20.139837 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:40:20.139837 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:40:20.139837 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:40:20.139837 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:40:20.139837 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:40:20.139837 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:40:20.139837 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: 9b20565451464b3f8e227b1804e9fb92 Oct 18 11:40:20.139837 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-VolumesNegativeTest-124437624 Oct 18 11:40:20.139837 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:40:20.139837 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:40:20.141287 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9b20565451464b3f8e227b1804e9fb92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9b20565451464b3f8e227b1804e9fb92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9b20565451464b3f8e227b1804e9fb92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9b20565451464b3f8e227b1804e9fb92"}]}] Oct 18 11:40:20.141287 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-VolumesNegativeTest-124437624 Oct 18 11:40:20.141287 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: 9b20565451464b3f8e227b1804e9fb92 Oct 18 11:40:20.141287 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-VolumesNegativeTest-124437624 Oct 18 11:40:20.141287 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-VolumesNegativeTest-124437624-project Oct 18 11:40:20.141287 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:40:20.141287 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:40:20.141287 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: 8fe6229212e4411fb2f617a7a49a570d Oct 18 11:40:20.141287 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-VolumesNegativeTest-124437624-project Oct 18 11:40:20.141287 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: Oct 18 11:40:20.141287 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Volume cf775e1f-07b5-495e-8076-991fa8bbbb62 could not be found. Oct 18 11:40:20.141287 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'id': 'cf775e1f-07b5-495e-8076-991fa8bbbb62'} Oct 18 11:40:20.141287 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:40:20.142054 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:20.142054 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 11:40:20.142054 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 11:40:20.142054 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 18 11:40:20.142054 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 18 11:40:20.142054 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 18 11:40:20.142054 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 18 11:40:20.142054 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 18 11:40:20.142054 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 18 11:40:20.142054 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 18 11:40:20.142054 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 18 11:40:20.142054 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 11:40:20.142054 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 11:40:20.142054 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 11:40:20.142054 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 11:40:20.142054 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cf775e1f-07b5-495e-8076-991fa8bbbb62 could not be found. (HTTP 404) (Request-ID: req-428bbf65-a08d-4f1b-912d-69aa056de181) Oct 18 11:40:20.142054 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:20.142054 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:40:20.142054 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:20.143131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:20.143131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 18 11:40:20.143131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 18 11:40:20.143131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 11:40:20.143131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 11:40:20.143131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 11:40:20.143131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 11:40:20.143131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 11:40:20.143131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 11:40:20.143131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 11:40:20.143131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 11:40:20.143131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 18 11:40:20.143131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 18 11:40:20.143131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 18 11:40:20.143131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 18 11:40:20.143131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 18 11:40:20.143131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 18 11:40:20.143131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 18 11:40:20.143131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 18 11:40:20.144249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 11:40:20.144249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 11:40:20.144249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 11:40:20.144249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 11:40:20.144249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cf775e1f-07b5-495e-8076-991fa8bbbb62 could not be found. Oct 18 11:40:20.144249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:20.144249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:40:20.144249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:20.144249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:20.144249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:40:20.144249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:40:20.144249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:40:20.144249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:40:20.144249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 11:40:20.144249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 11:40:20.144249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:40:20.144249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:40:20.144249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 18 11:40:20.144249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:40:20.145373 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cf775e1f-07b5-495e-8076-991fa8bbbb62 could not be found. Oct 18 11:40:20.145373 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:20.145373 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:40:20.145373 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:20.145373 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:20.145373 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:40:20.145373 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:40:20.145373 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:40:20.145373 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:40:20.145373 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cf775e1f-07b5-495e-8076-991fa8bbbb62 could not be found. Oct 18 11:40:20.145373 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:20.147849 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ad687fd7-ae2c-41da-a49e-cccdcb19a416 tempest-VolumesNegativeTest-124437624 tempest-VolumesNegativeTest-124437624-project] Returning 404 to user: Volume cf775e1f-07b5-495e-8076-991fa8bbbb62 could not be found. {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:40:20.148972 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-ad687fd7-ae2c-41da-a49e-cccdcb19a416 tempest-VolumesNegativeTest-124437624 tempest-VolumesNegativeTest-124437624-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/cf775e1f-07b5-495e-8076-991fa8bbbb62" status: 404 len: 109 microversion: 2.1 time: 0.234459 Oct 18 11:40:20.150420 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 7/7] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Oct 18 11:40:19 2022] DELETE /compute/v2.1/os-volumes/cf775e1f-07b5-495e-8076-991fa8bbbb62 => generated 109 bytes in 236 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 11:40:20.161658 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-1dd3f00c-301a-472d-9393-cddad1ee38ec tempest-VolumesNegativeTest-124437624 tempest-VolumesNegativeTest-124437624-project] Calling method '.version_select at 0x7f4be0dc8dc0>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:20.267108 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-b6567dd8-6d77-4da7-9dbe-ef6b4ffae2a4 tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.282463 Oct 18 11:40:20.271229 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 1/8] 10.222.0.17 () {60 vars in 1155 bytes} [Tue Oct 18 11:40:16 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3289 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 18 11:40:20.290143 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-300a3ad2-484c-495d-9c51-1b7ac0737318 tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] Calling method '.version_select at 0x7f4be0e7c9d0>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:20.305024 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.wsgi [None req-1dd3f00c-301a-472d-9393-cddad1ee38ec tempest-VolumesNegativeTest-124437624 tempest-VolumesNegativeTest-124437624-project] HTTP exception thrown: Volume dc03fa7c-9b16-4ae7-9368-eb4990b11741 could not be found. Oct 18 11:40:20.307493 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-1dd3f00c-301a-472d-9393-cddad1ee38ec tempest-VolumesNegativeTest-124437624 tempest-VolumesNegativeTest-124437624-project] Request method failure captured: Oct 18 11:40:20.307493 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: GET /compute/v2.1/os-volumes/dc03fa7c-9b16-4ae7-9368-eb4990b11741 HTTP/1.1 Oct 18 11:40:20.307493 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:40:20.307493 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:40:20.307493 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:40:20.307493 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 0 Oct 18 11:40:20.307493 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:40:20.307493 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:40:20.307493 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:40:20.307493 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:40:20.307493 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpCh6j4e2KmAbwVG0B9HqskCXWCkoAixvohy78I3evZ-VFZxTVobjo-3IAstf4sAtAFaxQRiTVN_WnYB-VQx9sI-Ts9_3ywWN0c5d3n5J0sxNJPOo7a3E4bNVZVb6jj3HcqwKWH8Hw235HZXC_oaFxBwNGGZnrDdIcpgYktPwET1XqE Oct 18 11:40:20.307493 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:40:20.307493 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:40:20.307493 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:40:20.307493 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:40:20.307493 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:40:20.307493 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:40:20.307493 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: 9b20565451464b3f8e227b1804e9fb92 Oct 18 11:40:20.307493 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-VolumesNegativeTest-124437624 Oct 18 11:40:20.307493 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:40:20.307493 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:40:20.308729 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9b20565451464b3f8e227b1804e9fb92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9b20565451464b3f8e227b1804e9fb92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9b20565451464b3f8e227b1804e9fb92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9b20565451464b3f8e227b1804e9fb92"}]}] Oct 18 11:40:20.308729 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-VolumesNegativeTest-124437624 Oct 18 11:40:20.308729 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: 9b20565451464b3f8e227b1804e9fb92 Oct 18 11:40:20.308729 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-VolumesNegativeTest-124437624 Oct 18 11:40:20.308729 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-VolumesNegativeTest-124437624-project Oct 18 11:40:20.308729 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:40:20.308729 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:40:20.308729 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: 8fe6229212e4411fb2f617a7a49a570d Oct 18 11:40:20.308729 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-VolumesNegativeTest-124437624-project Oct 18 11:40:20.308729 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: Oct 18 11:40:20.308729 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Volume dc03fa7c-9b16-4ae7-9368-eb4990b11741 could not be found. Oct 18 11:40:20.308729 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'id': 'dc03fa7c-9b16-4ae7-9368-eb4990b11741'} Oct 18 11:40:20.308729 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:40:20.311219 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:20.311219 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 11:40:20.311219 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 11:40:20.311219 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 11:40:20.311219 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 11:40:20.311219 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 11:40:20.311219 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 11:40:20.311219 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 11:40:20.311219 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 11:40:20.311219 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 11:40:20.311219 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 11:40:20.311219 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 11:40:20.311219 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 11:40:20.311219 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 11:40:20.311219 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 11:40:20.311219 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dc03fa7c-9b16-4ae7-9368-eb4990b11741 could not be found. (HTTP 404) (Request-ID: req-1f93d8e3-2520-4c6b-b786-62c580c3f4b9) Oct 18 11:40:20.311219 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:20.311219 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:40:20.311219 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:20.312336 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:20.312336 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 18 11:40:20.312336 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 18 11:40:20.312336 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 11:40:20.312336 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 11:40:20.312336 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 11:40:20.312336 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 11:40:20.312336 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 11:40:20.312336 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 11:40:20.312336 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 11:40:20.312336 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 11:40:20.312336 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 11:40:20.312336 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 11:40:20.312336 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 11:40:20.312336 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 11:40:20.312336 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 11:40:20.312336 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 11:40:20.312336 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 11:40:20.312336 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 11:40:20.313431 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 11:40:20.313431 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 11:40:20.313431 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 11:40:20.313431 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 11:40:20.313431 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dc03fa7c-9b16-4ae7-9368-eb4990b11741 could not be found. Oct 18 11:40:20.313431 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:20.313431 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:40:20.313431 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:20.313431 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:20.313431 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:40:20.313431 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:40:20.313431 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:40:20.313431 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:40:20.313431 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 11:40:20.313431 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 11:40:20.313431 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:40:20.313431 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:40:20.313431 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 18 11:40:20.313431 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:40:20.314730 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dc03fa7c-9b16-4ae7-9368-eb4990b11741 could not be found. Oct 18 11:40:20.314730 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:20.314730 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:40:20.314730 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:20.314730 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:20.314730 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:40:20.314730 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:40:20.314730 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:40:20.314730 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:40:20.314730 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dc03fa7c-9b16-4ae7-9368-eb4990b11741 could not be found. Oct 18 11:40:20.314730 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:20.314730 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-1dd3f00c-301a-472d-9393-cddad1ee38ec tempest-VolumesNegativeTest-124437624 tempest-VolumesNegativeTest-124437624-project] Returning 404 to user: Volume dc03fa7c-9b16-4ae7-9368-eb4990b11741 could not be found. {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:40:20.315412 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-1dd3f00c-301a-472d-9393-cddad1ee38ec tempest-VolumesNegativeTest-124437624 tempest-VolumesNegativeTest-124437624-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/dc03fa7c-9b16-4ae7-9368-eb4990b11741" status: 404 len: 109 microversion: 2.1 time: 0.151378 Oct 18 11:40:20.324260 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 8/9] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Oct 18 11:40:20 2022] GET /compute/v2.1/os-volumes/dc03fa7c-9b16-4ae7-9368-eb4990b11741 => generated 109 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 11:40:20.381650 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-300a3ad2-484c-495d-9c51-1b7ac0737318 tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b" status: 200 len: 345 microversion: 2.1 time: 0.095677 Oct 18 11:40:20.382296 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 2/10] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Oct 18 11:40:20 2022] GET /compute/v2.1/os-volumes/6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b => generated 345 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:40:21.399315 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-035a80ef-7b85-4e83-bb3e-3290e5f84ffb tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] Calling method '.version_select at 0x7f4be0dc8160>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:21.525144 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-035a80ef-7b85-4e83-bb3e-3290e5f84ffb tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b" status: 200 len: 346 microversion: 2.1 time: 0.132760 Oct 18 11:40:21.526140 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 9/11] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Oct 18 11:40:21 2022] GET /compute/v2.1/os-volumes/6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b => generated 346 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:40:21.541535 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-8a2db01e-c62e-445a-a40e-388c8905f1eb tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] Action: 'create', calling method: .version_select at 0x7f4be0e13040>, body: {"snapshot": {"volume_id": "6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1253596001"}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:40:22.148902 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-8a2db01e-c62e-445a-a40e-388c8905f1eb tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.611799 Oct 18 11:40:22.155476 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 3/12] 10.222.0.17 () {60 vars in 1162 bytes} [Tue Oct 18 11:40:21 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:40:22.163171 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-e18d1887-5aea-402a-a9a3-8885af7eb168 tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] Calling method '.version_select at 0x7f4be0d9c310>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:22.256404 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-e18d1887-5aea-402a-a9a3-8885af7eb168 tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/ce71f1d7-938d-46a1-a378-c2fe84179cd1" status: 200 len: 287 microversion: 2.1 time: 0.097999 Oct 18 11:40:22.257644 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 10/13] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Oct 18 11:40:22 2022] GET /compute/v2.1/os-snapshots/ce71f1d7-938d-46a1-a378-c2fe84179cd1 => generated 287 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:40:22.269252 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-542a0c08-074b-4962-9cc4-652fcace007c tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] Calling method '.version_select at 0x7f4be0e1d310>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:22.349120 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-542a0c08-074b-4962-9cc4-652fcace007c tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.083876 Oct 18 11:40:22.349741 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 4/14] 10.222.0.17 () {58 vars in 1140 bytes} [Tue Oct 18 11:40:22 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:40:22.364014 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-0022e8c2-e925-4153-9ebd-1aef848de5d4 tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] Calling method '.version_select at 0x7f4be0d9c8b0>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:22.416782 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-0022e8c2-e925-4153-9ebd-1aef848de5d4 tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/ce71f1d7-938d-46a1-a378-c2fe84179cd1" status: 200 len: 287 microversion: 2.1 time: 0.058166 Oct 18 11:40:22.418734 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 11/15] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Oct 18 11:40:22 2022] GET /compute/v2.1/os-snapshots/ce71f1d7-938d-46a1-a378-c2fe84179cd1 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:40:23.434341 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-962b731a-b5bf-4437-b5f3-6a0c96db3b55 tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] Calling method '.version_select at 0x7f4be0e13040>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:23.632718 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-962b731a-b5bf-4437-b5f3-6a0c96db3b55 tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/ce71f1d7-938d-46a1-a378-c2fe84179cd1" status: 200 len: 287 microversion: 2.1 time: 0.203889 Oct 18 11:40:23.637593 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 5/16] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Oct 18 11:40:23 2022] GET /compute/v2.1/os-snapshots/ce71f1d7-938d-46a1-a378-c2fe84179cd1 => generated 287 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:40:24.646306 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-588948a2-3af9-4d77-b766-88d6dff9efb4 tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] Calling method '.version_select at 0x7f4be0dc84c0>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:24.708195 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-588948a2-3af9-4d77-b766-88d6dff9efb4 tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/ce71f1d7-938d-46a1-a378-c2fe84179cd1" status: 200 len: 287 microversion: 2.1 time: 0.066553 Oct 18 11:40:24.708750 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 12/17] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Oct 18 11:40:24 2022] GET /compute/v2.1/os-snapshots/ce71f1d7-938d-46a1-a378-c2fe84179cd1 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:40:25.722401 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-68abc48e-3841-4f1f-8fe7-ad45b7ff7f93 tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] Calling method '.version_select at 0x7f4be0e7ca60>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:25.763959 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-68abc48e-3841-4f1f-8fe7-ad45b7ff7f93 tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/ce71f1d7-938d-46a1-a378-c2fe84179cd1" status: 200 len: 288 microversion: 2.1 time: 0.045691 Oct 18 11:40:25.764716 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 6/18] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Oct 18 11:40:25 2022] GET /compute/v2.1/os-snapshots/ce71f1d7-938d-46a1-a378-c2fe84179cd1 => generated 288 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:40:25.776699 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-e624ef15-2e3b-4e32-b497-d959cf4ef617 tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] Calling method '.version_select at 0x7f4be0d9cc10>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:25.927303 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-e624ef15-2e3b-4e32-b497-d959cf4ef617 tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/ce71f1d7-938d-46a1-a378-c2fe84179cd1" status: 202 len: 0 microversion: 2.1 time: 0.154701 Oct 18 11:40:25.927742 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 13/19] 10.222.0.17 () {58 vars in 1254 bytes} [Tue Oct 18 11:40:25 2022] DELETE /compute/v2.1/os-snapshots/ce71f1d7-938d-46a1-a378-c2fe84179cd1 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 11:40:25.935910 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-fb78a90c-e547-4c68-a1b4-fe4eed2434c2 tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] Calling method '.version_select at 0x7f4be0e1d280>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:26.022136 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-fb78a90c-e547-4c68-a1b4-fe4eed2434c2 tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/ce71f1d7-938d-46a1-a378-c2fe84179cd1" status: 200 len: 287 microversion: 2.1 time: 0.089972 Oct 18 11:40:26.023772 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 7/20] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Oct 18 11:40:25 2022] GET /compute/v2.1/os-snapshots/ce71f1d7-938d-46a1-a378-c2fe84179cd1 => generated 287 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:40:27.036366 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-57911e89-5b03-4255-82ef-4ea66d9bb42d tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] Calling method '.version_select at 0x7f4be0d9c430>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:27.128471 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.wsgi [None req-57911e89-5b03-4255-82ef-4ea66d9bb42d tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] HTTP exception thrown: Snapshot ce71f1d7-938d-46a1-a378-c2fe84179cd1 could not be found. Oct 18 11:40:27.130975 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-57911e89-5b03-4255-82ef-4ea66d9bb42d tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] Request method failure captured: Oct 18 11:40:27.130975 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: GET /compute/v2.1/os-snapshots/ce71f1d7-938d-46a1-a378-c2fe84179cd1 HTTP/1.1 Oct 18 11:40:27.130975 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:40:27.130975 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:40:27.130975 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:40:27.130975 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 0 Oct 18 11:40:27.130975 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:40:27.130975 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:40:27.130975 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:40:27.130975 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:40:27.130975 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpCgCXfbNybOvrDEmBoWsYsk6iNXSAKsAlUh2sXKjvVDHHvUq9bCkl2DfLtOwfp3Lrnzk9ML5-pk8bHBitCKsqrbpJSAeefWHEQ1P9JvfrvtL2DyIWSlOQ9YIw-LwcxGgWuKtc3QCkc7Cj4-DA5CwToHdU4BRMo_IvO5IZGO3vRgV9k Oct 18 11:40:27.130975 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:40:27.130975 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:40:27.130975 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:40:27.130975 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:40:27.130975 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:40:27.130975 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:40:27.130975 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: 8d0104a11c7241ee99ee49f32611807f Oct 18 11:40:27.130975 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2119682857 Oct 18 11:40:27.130975 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:40:27.130975 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:40:27.132499 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8d0104a11c7241ee99ee49f32611807f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8d0104a11c7241ee99ee49f32611807f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8d0104a11c7241ee99ee49f32611807f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8d0104a11c7241ee99ee49f32611807f"}]}] Oct 18 11:40:27.132499 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2119682857 Oct 18 11:40:27.132499 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: 8d0104a11c7241ee99ee49f32611807f Oct 18 11:40:27.132499 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2119682857 Oct 18 11:40:27.132499 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-VolumesSnapshotsTestJSON-2119682857-project Oct 18 11:40:27.132499 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:40:27.132499 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:40:27.132499 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: c3a261fe763b4e8583929c496ecf342a Oct 18 11:40:27.132499 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2119682857-project Oct 18 11:40:27.132499 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: Oct 18 11:40:27.132499 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Snapshot ce71f1d7-938d-46a1-a378-c2fe84179cd1 could not be found. Oct 18 11:40:27.132499 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'id': 'ce71f1d7-938d-46a1-a378-c2fe84179cd1'} Oct 18 11:40:27.132499 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:40:27.133579 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:27.133579 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 18 11:40:27.133579 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 18 11:40:27.133579 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 18 11:40:27.133579 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 18 11:40:27.133579 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 18 11:40:27.133579 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 18 11:40:27.133579 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 11:40:27.133579 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 11:40:27.133579 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 11:40:27.133579 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 11:40:27.133579 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 11:40:27.133579 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 11:40:27.133579 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 11:40:27.133579 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 11:40:27.133579 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ce71f1d7-938d-46a1-a378-c2fe84179cd1 could not be found. (HTTP 404) (Request-ID: req-a4211f51-7c7a-474c-a949-ac988ed65eaf) Oct 18 11:40:27.133579 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:27.133579 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:40:27.134760 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:27.134760 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:27.134760 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 18 11:40:27.134760 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 18 11:40:27.134760 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 11:40:27.134760 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 11:40:27.134760 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 18 11:40:27.134760 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 18 11:40:27.134760 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 11:40:27.134760 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 11:40:27.134760 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 18 11:40:27.134760 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 18 11:40:27.134760 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 18 11:40:27.134760 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 18 11:40:27.134760 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 18 11:40:27.134760 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 18 11:40:27.134760 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 11:40:27.134760 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 11:40:27.134760 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 11:40:27.135797 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 11:40:27.135797 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 11:40:27.135797 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 11:40:27.135797 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 11:40:27.135797 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 11:40:27.135797 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ce71f1d7-938d-46a1-a378-c2fe84179cd1 could not be found. Oct 18 11:40:27.135797 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:27.135797 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:40:27.135797 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:27.135797 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:27.135797 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:40:27.135797 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:40:27.135797 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:40:27.135797 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:40:27.135797 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 11:40:27.135797 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 11:40:27.135797 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:40:27.135797 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:40:27.135797 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 18 11:40:27.135797 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:40:27.137199 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ce71f1d7-938d-46a1-a378-c2fe84179cd1 could not be found. Oct 18 11:40:27.137199 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:27.137199 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:40:27.137199 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:27.137199 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:27.137199 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:40:27.137199 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:40:27.137199 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:40:27.137199 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:40:27.137199 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ce71f1d7-938d-46a1-a378-c2fe84179cd1 could not be found. Oct 18 11:40:27.137199 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:27.138164 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-57911e89-5b03-4255-82ef-4ea66d9bb42d tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] Returning 404 to user: Snapshot ce71f1d7-938d-46a1-a378-c2fe84179cd1 could not be found. {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:40:27.139113 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-57911e89-5b03-4255-82ef-4ea66d9bb42d tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/ce71f1d7-938d-46a1-a378-c2fe84179cd1" status: 404 len: 111 microversion: 2.1 time: 0.107513 Oct 18 11:40:27.140123 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 14/21] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Oct 18 11:40:27 2022] GET /compute/v2.1/os-snapshots/ce71f1d7-938d-46a1-a378-c2fe84179cd1 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:40:27.148633 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-d3da98d2-56df-4151-a35e-33bcf9c06f73 tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] Calling method '.version_select at 0x7f4be0e7ca60>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:27.453322 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-d3da98d2-56df-4151-a35e-33bcf9c06f73 tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b" status: 202 len: 0 microversion: 2.1 time: 0.308908 Oct 18 11:40:27.454250 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 8/22] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Oct 18 11:40:27 2022] DELETE /compute/v2.1/os-volumes/6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 11:40:27.463230 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-a9c47989-f197-4b04-9db6-a1bc70f27cb6 tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] Calling method '.version_select at 0x7f4be0e13550>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:27.659832 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-a9c47989-f197-4b04-9db6-a1bc70f27cb6 tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b" status: 200 len: 345 microversion: 2.1 time: 0.200805 Oct 18 11:40:27.660681 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 9/23] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Oct 18 11:40:27 2022] GET /compute/v2.1/os-volumes/6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b => generated 345 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:40:27.871410 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-deb57da3-dbc8-4e5b-a46f-7a5dd4c5ca81 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Action: 'create', calling method: .version_select at 0x7f4be0d9cdc0>, body: {"keypair": {"name": "tempest-keypair-593272598", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaCD+BgUtr52cquknDS4cicisvqwZQVUQTdq3eMoMdrykNtJMeoqf0kFCbmH8gdbqPbcTQrXrZ6Xo3m82Z6Jh+soV6TsvaermItIAqjG8UiUGU+Sx42LqszlYjATfWBqQ=="}} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:40:27.997340 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.quota [None req-deb57da3-dbc8-4e5b-a46f-7a5dd4c5ca81 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Getting quotas for project ffc96760658d4e19af26d6cf22e94172. Resources: {'key_pairs'} {{(pid=125485) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:40:28.005658 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.quota [None req-deb57da3-dbc8-4e5b-a46f-7a5dd4c5ca81 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Getting quotas for user bddd3d2bb8f647f2ba616141eb16622e and project ffc96760658d4e19af26d6cf22e94172. Resources: {'key_pairs'} {{(pid=125485) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:40:28.080302 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-deb57da3-dbc8-4e5b-a46f-7a5dd4c5ca81 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.643213 Oct 18 11:40:28.081629 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 15/24] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Oct 18 11:40:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:40:28.677058 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-fe965cf8-2491-4e3c-acaa-ab4ea778520c tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] Calling method '.version_select at 0x7f4be0e13a60>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:28.736179 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.wsgi [None req-fe965cf8-2491-4e3c-acaa-ab4ea778520c tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] HTTP exception thrown: Volume 6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b could not be found. Oct 18 11:40:28.741726 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-fe965cf8-2491-4e3c-acaa-ab4ea778520c tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] Request method failure captured: Oct 18 11:40:28.741726 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: request: GET /compute/v2.1/os-volumes/6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b HTTP/1.1 Oct 18 11:40:28.741726 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept: application/json Oct 18 11:40:28.741726 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept-Encoding: identity Oct 18 11:40:28.741726 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Connection: close Oct 18 11:40:28.741726 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Length: 0 Oct 18 11:40:28.741726 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Type: application/json Oct 18 11:40:28.741726 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Host: 10.222.0.17 Oct 18 11:40:28.741726 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Openstack-System-Scope: None Oct 18 11:40:28.741726 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: User-Agent: python-urllib3/1.26.12 Oct 18 11:40:28.741726 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Auth-Token: gAAAAABjTpCgCXfbNybOvrDEmBoWsYsk6iNXSAKsAlUh2sXKjvVDHHvUq9bCkl2DfLtOwfp3Lrnzk9ML5-pk8bHBitCKsqrbpJSAeefWHEQ1P9JvfrvtL2DyIWSlOQ9YIw-LwcxGgWuKtc3QCkc7Cj4-DA5CwToHdU4BRMo_IvO5IZGO3vRgV9k Oct 18 11:40:28.741726 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Id: None Oct 18 11:40:28.741726 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Name: None Oct 18 11:40:28.741726 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Identity-Status: Confirmed Oct 18 11:40:28.741726 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Is-Admin-Project: True Oct 18 11:40:28.741726 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Id: default Oct 18 11:40:28.741726 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Name: Default Oct 18 11:40:28.741726 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Id: 8d0104a11c7241ee99ee49f32611807f Oct 18 11:40:28.741726 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2119682857 Oct 18 11:40:28.741726 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Role: reader,member Oct 18 11:40:28.741726 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Roles: reader,member Oct 18 11:40:28.743349 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8d0104a11c7241ee99ee49f32611807f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8d0104a11c7241ee99ee49f32611807f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8d0104a11c7241ee99ee49f32611807f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8d0104a11c7241ee99ee49f32611807f"}]}] Oct 18 11:40:28.743349 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2119682857 Oct 18 11:40:28.743349 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Id: 8d0104a11c7241ee99ee49f32611807f Oct 18 11:40:28.743349 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2119682857 Oct 18 11:40:28.743349 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User: tempest-VolumesSnapshotsTestJSON-2119682857-project Oct 18 11:40:28.743349 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Id: default Oct 18 11:40:28.743349 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Name: Default Oct 18 11:40:28.743349 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Id: c3a261fe763b4e8583929c496ecf342a Oct 18 11:40:28.743349 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2119682857-project Oct 18 11:40:28.743349 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: method: Oct 18 11:40:28.743349 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: exception: Volume 6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b could not be found. Oct 18 11:40:28.743349 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: action_args: {'id': '6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b'} Oct 18 11:40:28.743349 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:40:28.744602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:28.744602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 11:40:28.744602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 11:40:28.744602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 11:40:28.744602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 11:40:28.744602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 11:40:28.744602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 11:40:28.744602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 11:40:28.744602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 11:40:28.744602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 11:40:28.744602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 11:40:28.744602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 11:40:28.744602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 11:40:28.744602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 11:40:28.744602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 11:40:28.744602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b could not be found. (HTTP 404) (Request-ID: req-5cc128f6-4a43-41b4-922c-29050b955ec6) Oct 18 11:40:28.744602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:40:28.744602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:40:28.744602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:40:28.746615 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:28.746615 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 18 11:40:28.746615 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 18 11:40:28.746615 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 11:40:28.746615 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 11:40:28.746615 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 11:40:28.746615 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 11:40:28.746615 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 11:40:28.746615 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 11:40:28.746615 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 11:40:28.746615 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 11:40:28.746615 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 11:40:28.746615 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 11:40:28.746615 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 11:40:28.746615 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 11:40:28.746615 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 11:40:28.746615 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 11:40:28.746615 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 11:40:28.746615 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 11:40:28.748710 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 11:40:28.748710 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 11:40:28.748710 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 11:40:28.748710 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 11:40:28.748710 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b could not be found. Oct 18 11:40:28.748710 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:40:28.748710 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:40:28.748710 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:40:28.748710 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:28.748710 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:40:28.748710 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:40:28.748710 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:40:28.748710 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:40:28.748710 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 11:40:28.748710 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 11:40:28.748710 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:40:28.748710 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:40:28.748710 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 18 11:40:28.748710 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:40:28.750233 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b could not be found. Oct 18 11:40:28.750233 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:40:28.750233 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:40:28.750233 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:40:28.750233 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:28.750233 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:40:28.750233 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:40:28.750233 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:40:28.750233 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:40:28.750233 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b could not be found. Oct 18 11:40:28.750233 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:40:28.750233 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-fe965cf8-2491-4e3c-acaa-ab4ea778520c tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] Returning 404 to user: Volume 6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b could not be found. {{(pid=125486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:40:28.750233 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-fe965cf8-2491-4e3c-acaa-ab4ea778520c tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b" status: 404 len: 109 microversion: 2.1 time: 0.071631 Oct 18 11:40:28.750233 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 10/25] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Oct 18 11:40:28 2022] GET /compute/v2.1/os-volumes/6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:40:28.761918 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-50284708-0b30-49ee-a220-37fa7da4a8ce tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] Calling method '.version_select at 0x7f4be0d04f70>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:28.831484 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.wsgi [None req-50284708-0b30-49ee-a220-37fa7da4a8ce tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] HTTP exception thrown: Volume 6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b could not be found. Oct 18 11:40:28.833779 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-50284708-0b30-49ee-a220-37fa7da4a8ce tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] Request method failure captured: Oct 18 11:40:28.833779 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: DELETE /compute/v2.1/os-volumes/6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b HTTP/1.1 Oct 18 11:40:28.833779 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:40:28.833779 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:40:28.833779 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:40:28.833779 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 0 Oct 18 11:40:28.833779 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:40:28.833779 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:40:28.833779 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:40:28.833779 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:40:28.833779 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpCgCXfbNybOvrDEmBoWsYsk6iNXSAKsAlUh2sXKjvVDHHvUq9bCkl2DfLtOwfp3Lrnzk9ML5-pk8bHBitCKsqrbpJSAeefWHEQ1P9JvfrvtL2DyIWSlOQ9YIw-LwcxGgWuKtc3QCkc7Cj4-DA5CwToHdU4BRMo_IvO5IZGO3vRgV9k Oct 18 11:40:28.833779 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:40:28.833779 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:40:28.833779 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:40:28.833779 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:40:28.833779 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:40:28.833779 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:40:28.833779 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: 8d0104a11c7241ee99ee49f32611807f Oct 18 11:40:28.833779 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2119682857 Oct 18 11:40:28.833779 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:40:28.833779 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:40:28.835414 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8d0104a11c7241ee99ee49f32611807f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8d0104a11c7241ee99ee49f32611807f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8d0104a11c7241ee99ee49f32611807f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8d0104a11c7241ee99ee49f32611807f"}]}] Oct 18 11:40:28.835414 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2119682857 Oct 18 11:40:28.835414 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: 8d0104a11c7241ee99ee49f32611807f Oct 18 11:40:28.835414 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2119682857 Oct 18 11:40:28.835414 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-VolumesSnapshotsTestJSON-2119682857-project Oct 18 11:40:28.835414 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:40:28.835414 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:40:28.835414 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: c3a261fe763b4e8583929c496ecf342a Oct 18 11:40:28.835414 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2119682857-project Oct 18 11:40:28.835414 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: Oct 18 11:40:28.835414 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Volume 6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b could not be found. Oct 18 11:40:28.835414 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'id': '6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b'} Oct 18 11:40:28.835414 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:40:28.836542 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:28.836542 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 11:40:28.836542 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 11:40:28.836542 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 18 11:40:28.836542 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 18 11:40:28.836542 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 18 11:40:28.836542 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 18 11:40:28.836542 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 18 11:40:28.836542 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 18 11:40:28.836542 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 18 11:40:28.836542 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 18 11:40:28.836542 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 11:40:28.836542 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 11:40:28.836542 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 11:40:28.836542 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 11:40:28.836542 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b could not be found. (HTTP 404) (Request-ID: req-c0a944d4-3252-48a0-af81-39c8bf83d346) Oct 18 11:40:28.836542 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:28.836542 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:40:28.836542 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:28.837925 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:28.837925 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 18 11:40:28.837925 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 18 11:40:28.837925 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 11:40:28.837925 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 11:40:28.837925 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 11:40:28.837925 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 11:40:28.837925 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 11:40:28.837925 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 11:40:28.837925 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 11:40:28.837925 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 11:40:28.837925 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 18 11:40:28.837925 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 18 11:40:28.837925 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 18 11:40:28.837925 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 18 11:40:28.837925 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 18 11:40:28.837925 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 18 11:40:28.837925 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 18 11:40:28.837925 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 18 11:40:28.839259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 11:40:28.839259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 11:40:28.839259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 11:40:28.839259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 11:40:28.839259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b could not be found. Oct 18 11:40:28.839259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:28.839259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:40:28.839259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:28.839259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:28.839259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:40:28.839259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:40:28.839259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:40:28.839259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:40:28.839259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 11:40:28.839259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 11:40:28.839259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:40:28.839259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:40:28.839259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 18 11:40:28.839259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:40:28.840607 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b could not be found. Oct 18 11:40:28.840607 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:28.840607 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:40:28.840607 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:28.840607 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:28.840607 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:40:28.840607 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:40:28.840607 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:40:28.840607 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:40:28.840607 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b could not be found. Oct 18 11:40:28.840607 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:40:28.840607 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-50284708-0b30-49ee-a220-37fa7da4a8ce tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] Returning 404 to user: Volume 6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b could not be found. {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:40:28.843232 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-50284708-0b30-49ee-a220-37fa7da4a8ce tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b" status: 404 len: 109 microversion: 2.1 time: 0.085025 Oct 18 11:40:28.843698 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 16/26] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Oct 18 11:40:28 2022] DELETE /compute/v2.1/os-volumes/6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:40:28.851211 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-0a12e6f3-d8a1-4415-a9f5-7f29b4b5f23e tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] Calling method '.version_select at 0x7f4be0e1de50>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:28.930162 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.wsgi [None req-0a12e6f3-d8a1-4415-a9f5-7f29b4b5f23e tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] HTTP exception thrown: Volume 6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b could not be found. Oct 18 11:40:28.932992 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-0a12e6f3-d8a1-4415-a9f5-7f29b4b5f23e tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] Request method failure captured: Oct 18 11:40:28.932992 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: request: GET /compute/v2.1/os-volumes/6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b HTTP/1.1 Oct 18 11:40:28.932992 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept: application/json Oct 18 11:40:28.932992 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept-Encoding: identity Oct 18 11:40:28.932992 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Connection: close Oct 18 11:40:28.932992 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Length: 0 Oct 18 11:40:28.932992 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Type: application/json Oct 18 11:40:28.932992 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Host: 10.222.0.17 Oct 18 11:40:28.932992 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Openstack-System-Scope: None Oct 18 11:40:28.932992 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: User-Agent: python-urllib3/1.26.12 Oct 18 11:40:28.932992 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Auth-Token: gAAAAABjTpCgCXfbNybOvrDEmBoWsYsk6iNXSAKsAlUh2sXKjvVDHHvUq9bCkl2DfLtOwfp3Lrnzk9ML5-pk8bHBitCKsqrbpJSAeefWHEQ1P9JvfrvtL2DyIWSlOQ9YIw-LwcxGgWuKtc3QCkc7Cj4-DA5CwToHdU4BRMo_IvO5IZGO3vRgV9k Oct 18 11:40:28.932992 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Id: None Oct 18 11:40:28.932992 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Name: None Oct 18 11:40:28.932992 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Identity-Status: Confirmed Oct 18 11:40:28.932992 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Is-Admin-Project: True Oct 18 11:40:28.932992 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Id: default Oct 18 11:40:28.932992 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Name: Default Oct 18 11:40:28.932992 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Id: 8d0104a11c7241ee99ee49f32611807f Oct 18 11:40:28.932992 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2119682857 Oct 18 11:40:28.932992 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Role: reader,member Oct 18 11:40:28.932992 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Roles: reader,member Oct 18 11:40:28.934494 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8d0104a11c7241ee99ee49f32611807f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8d0104a11c7241ee99ee49f32611807f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8d0104a11c7241ee99ee49f32611807f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8d0104a11c7241ee99ee49f32611807f"}]}] Oct 18 11:40:28.934494 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2119682857 Oct 18 11:40:28.934494 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Id: 8d0104a11c7241ee99ee49f32611807f Oct 18 11:40:28.934494 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2119682857 Oct 18 11:40:28.934494 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User: tempest-VolumesSnapshotsTestJSON-2119682857-project Oct 18 11:40:28.934494 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Id: default Oct 18 11:40:28.934494 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Name: Default Oct 18 11:40:28.934494 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Id: c3a261fe763b4e8583929c496ecf342a Oct 18 11:40:28.934494 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2119682857-project Oct 18 11:40:28.934494 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: method: Oct 18 11:40:28.934494 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: exception: Volume 6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b could not be found. Oct 18 11:40:28.934494 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: action_args: {'id': '6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b'} Oct 18 11:40:28.934494 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:40:28.935416 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:28.935416 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 11:40:28.935416 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 11:40:28.935416 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 11:40:28.935416 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 11:40:28.935416 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 11:40:28.935416 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 11:40:28.935416 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 11:40:28.935416 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 11:40:28.935416 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 11:40:28.935416 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 11:40:28.935416 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 11:40:28.935416 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 11:40:28.935416 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 11:40:28.935416 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 11:40:28.935416 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b could not be found. (HTTP 404) (Request-ID: req-304b190e-5ab4-461e-8e67-c52520e21871) Oct 18 11:40:28.935416 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:40:28.935416 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:40:28.935416 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:40:28.936718 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:28.936718 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 18 11:40:28.936718 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 18 11:40:28.936718 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 11:40:28.936718 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 11:40:28.936718 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 11:40:28.936718 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 11:40:28.936718 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 11:40:28.936718 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 11:40:28.936718 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 11:40:28.936718 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 11:40:28.936718 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 11:40:28.936718 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 11:40:28.936718 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 11:40:28.936718 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 11:40:28.936718 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 11:40:28.936718 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 11:40:28.936718 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 11:40:28.936718 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 11:40:28.938051 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 11:40:28.938051 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 11:40:28.938051 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 11:40:28.938051 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 11:40:28.938051 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b could not be found. Oct 18 11:40:28.938051 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:40:28.938051 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:40:28.938051 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:40:28.938051 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:28.938051 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:40:28.938051 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:40:28.938051 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:40:28.938051 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:40:28.938051 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 11:40:28.938051 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 11:40:28.938051 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:40:28.938051 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:40:28.938051 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 18 11:40:28.938051 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:40:28.939703 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b could not be found. Oct 18 11:40:28.939703 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:40:28.939703 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:40:28.939703 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:40:28.939703 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:40:28.939703 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:40:28.939703 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:40:28.939703 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:40:28.939703 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:40:28.939703 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b could not be found. Oct 18 11:40:28.939703 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:40:28.939703 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-0a12e6f3-d8a1-4415-a9f5-7f29b4b5f23e tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] Returning 404 to user: Volume 6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b could not be found. {{(pid=125486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:40:28.939703 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-0a12e6f3-d8a1-4415-a9f5-7f29b4b5f23e tempest-VolumesSnapshotsTestJSON-2119682857 tempest-VolumesSnapshotsTestJSON-2119682857-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b" status: 404 len: 109 microversion: 2.1 time: 0.087068 Oct 18 11:40:28.940990 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 11/27] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Oct 18 11:40:28 2022] GET /compute/v2.1/os-volumes/6d542ddc-b06f-4d99-bfc0-75ec25ccdd7b => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:40:32.420300 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-f00bf0f9-b84c-4bd5-a36b-6b75fd1ce275 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1084264078", "imageRef": "a4917b56-ebe0-409a-894a-469900c12b94", "flavorRef": "452", "networks": [{"uuid": "42e50b03-504e-4016-9b2f-8446df6e0da5"}]}} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:40:32.619164 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.network.neutron [None req-f00bf0f9-b84c-4bd5-a36b-6b75fd1ce275 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] validate_networks() for [('42e50b03-504e-4016-9b2f-8446df6e0da5', None, None, None, None, None)] {{(pid=125485) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 11:40:35.399937 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-2361723f-afa4-4888-b63f-b84b253b470e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-501741102", "imageRef": "a4917b56-ebe0-409a-894a-469900c12b94", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:40:35.685704 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.network.neutron [None req-2361723f-afa4-4888-b63f-b84b253b470e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] validate_networks() for [('d9a6a3c3-a9a4-423b-a361-9c522f10f068', None, None, None, None, None)] {{(pid=125486) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 11:40:36.199820 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-f00bf0f9-b84c-4bd5-a36b-6b75fd1ce275 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Flavor limits 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 11:40:36.200984 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-f00bf0f9-b84c-4bd5-a36b-6b75fd1ce275 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Image limits 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 11:40:36.201715 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-f00bf0f9-b84c-4bd5-a36b-6b75fd1ce275 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Flavor pref 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 11:40:36.202613 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-f00bf0f9-b84c-4bd5-a36b-6b75fd1ce275 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Image pref 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 11:40:36.203429 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-f00bf0f9-b84c-4bd5-a36b-6b75fd1ce275 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 11:40:36.266610 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f00bf0f9-b84c-4bd5-a36b-6b75fd1ce275 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:36.268275 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f00bf0f9-b84c-4bd5-a36b-6b75fd1ce275 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:36.268996 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f00bf0f9-b84c-4bd5-a36b-6b75fd1ce275 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:36.269938 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f00bf0f9-b84c-4bd5-a36b-6b75fd1ce275 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:36.270605 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f00bf0f9-b84c-4bd5-a36b-6b75fd1ce275 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:36.271504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f00bf0f9-b84c-4bd5-a36b-6b75fd1ce275 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:36.311758 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.quota [None req-f00bf0f9-b84c-4bd5-a36b-6b75fd1ce275 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Getting quotas for project 6c580418dbc24525b6631dcd0a5f7876. Resources: {'cores', 'instances', 'ram'} {{(pid=125485) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:40:36.317786 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.quota [None req-f00bf0f9-b84c-4bd5-a36b-6b75fd1ce275 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Getting quotas for user 47bc074aee7d427bb0336fd19d31ef9d and project 6c580418dbc24525b6631dcd0a5f7876. Resources: {'cores', 'instances', 'ram'} {{(pid=125485) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:40:36.340506 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-f00bf0f9-b84c-4bd5-a36b-6b75fd1ce275 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Going to run 1 instances... {{(pid=125485) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 11:40:36.345747 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-f00bf0f9-b84c-4bd5-a36b-6b75fd1ce275 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4917b56-ebe0-409a-894a-469900c12b94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125485) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 11:40:36.553863 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-f00bf0f9-b84c-4bd5-a36b-6b75fd1ce275 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.429458 Oct 18 11:40:36.555106 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 17/28] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Oct 18 11:40:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 4431 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 11:40:36.569527 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-186d9caa-bfd5-4dfc-9af9-0772ccd5e5b6 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:36.572521 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-186d9caa-bfd5-4dfc-9af9-0772ccd5e5b6 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:36.771938 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-186d9caa-bfd5-4dfc-9af9-0772ccd5e5b6 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc074aee7d427bb0336fd19d31ef9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c580418dbc24525b6631dcd0a5f7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:36.834538 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-186d9caa-bfd5-4dfc-9af9-0772ccd5e5b6 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] 10.222.0.17 "GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33" status: 200 len: 1215 microversion: 2.1 time: 0.270230 Oct 18 11:40:36.835143 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 18/29] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:36 2022] GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33 => generated 1215 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:37.846909 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-6f33f0d7-09d7-4028-a3d5-eddaf41097bf tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Action: 'create', calling method: .version_select at 0x7f4be0d38940>, body: {"keypair": {"name": "tempest-keypair-1084490736", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLND1PJS3FBOmRzLdIHeoTmC1V3T5xr5Jd9dg+nGAsHUfkh+lmDrolz/0dvPMkKDPuwwPma8KZUe6UEvz/FIwE3k2GwGJqg+Rz2CB62+k4JoTDyv6s2wixVvEmH1DXwuKQ=="}} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:40:37.927734 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.quota [None req-6f33f0d7-09d7-4028-a3d5-eddaf41097bf tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Getting quotas for project 633afaabbbff47a4a99ebc997e67b01a. Resources: {'key_pairs'} {{(pid=125485) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:40:37.943055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.quota [None req-6f33f0d7-09d7-4028-a3d5-eddaf41097bf tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Getting quotas for user 916699a212eb4d8aa945f299ac0d4c96 and project 633afaabbbff47a4a99ebc997e67b01a. Resources: {'key_pairs'} {{(pid=125485) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:40:37.957428 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-2361723f-afa4-4888-b63f-b84b253b470e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Flavor limits 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 11:40:37.957893 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-2361723f-afa4-4888-b63f-b84b253b470e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Image limits 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 11:40:37.958319 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-2361723f-afa4-4888-b63f-b84b253b470e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Flavor pref 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 11:40:37.958872 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-2361723f-afa4-4888-b63f-b84b253b470e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Image pref 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 11:40:37.959445 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-2361723f-afa4-4888-b63f-b84b253b470e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 11:40:38.002456 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2361723f-afa4-4888-b63f-b84b253b470e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:38.005007 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2361723f-afa4-4888-b63f-b84b253b470e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:38.006762 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2361723f-afa4-4888-b63f-b84b253b470e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:38.008094 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2361723f-afa4-4888-b63f-b84b253b470e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:38.008901 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2361723f-afa4-4888-b63f-b84b253b470e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:38.010437 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2361723f-afa4-4888-b63f-b84b253b470e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:38.045474 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-6f33f0d7-09d7-4028-a3d5-eddaf41097bf tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.066830 Oct 18 11:40:38.057854 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 19/30] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Oct 18 11:40:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:40:38.068232 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-7e805348-6621-488d-8ce0-608f07bdc385 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1995714402", "imageRef": "a4917b56-ebe0-409a-894a-469900c12b94", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e349e211-459b-40e0-9dfd-ac48079863f5"}], "security_groups": [{"name": "tempest-securitygroup--65904896"}], "key_name": "tempest-keypair-593272598", "user_data": "}} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:40:38.135437 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-2361723f-afa4-4888-b63f-b84b253b470e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Getting quotas for project cd52252f24114465af9bdf6e6fe68b76. Resources: {'cores', 'instances', 'ram'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:40:38.156275 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-2361723f-afa4-4888-b63f-b84b253b470e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Getting quotas for user 1f624c36a3574b61bd17d5d73af71916 and project cd52252f24114465af9bdf6e6fe68b76. Resources: {'cores', 'instances', 'ram'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:40:38.202526 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-2361723f-afa4-4888-b63f-b84b253b470e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Going to run 1 instances... {{(pid=125486) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 11:40:38.211250 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-2361723f-afa4-4888-b63f-b84b253b470e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4917b56-ebe0-409a-894a-469900c12b94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 11:40:38.385992 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.network.neutron [None req-7e805348-6621-488d-8ce0-608f07bdc385 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] validate_networks() for [('e349e211-459b-40e0-9dfd-ac48079863f5', None, None, None, None, None)] {{(pid=125485) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 11:40:38.468266 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-2361723f-afa4-4888-b63f-b84b253b470e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.814607 Oct 18 11:40:38.473206 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 12/31] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Oct 18 11:40:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 3821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 11:40:38.492400 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-a7e0c78a-3868-4260-a192-c115ecec29cb tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:38.493159 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-a7e0c78a-3868-4260-a192-c115ecec29cb tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:38.721309 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-a7e0c78a-3868-4260-a192-c115ecec29cb tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc074aee7d427bb0336fd19d31ef9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c580418dbc24525b6631dcd0a5f7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:38.769634 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-a7e0c78a-3868-4260-a192-c115ecec29cb tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] 10.222.0.17 "GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33" status: 200 len: 1215 microversion: 2.1 time: 0.289589 Oct 18 11:40:38.770997 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 13/32] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:38 2022] GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33 => generated 1215 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:38.799447 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-c6a3285c-07b9-49aa-be2d-c4bb971cd480 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:38.800095 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-c6a3285c-07b9-49aa-be2d-c4bb971cd480 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:38.993276 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-c6a3285c-07b9-49aa-be2d-c4bb971cd480 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:39.004187 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-c6a3285c-07b9-49aa-be2d-c4bb971cd480 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b" status: 200 len: 1221 microversion: 2.1 time: 0.227637 Oct 18 11:40:39.017881 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 14/33] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:38 2022] GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b => generated 1221 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:39.585433 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-a709c107-b227-49e1-ad63-6acd6f3ec185 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-974166726", "imageRef": "a4917b56-ebe0-409a-894a-469900c12b94", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:40:39.744011 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.network.neutron [None req-a709c107-b227-49e1-ad63-6acd6f3ec185 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] validate_networks() for [('d9a6a3c3-a9a4-423b-a361-9c522f10f068', None, None, None, None, None)] {{(pid=125486) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 11:40:40.725374 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-7e805348-6621-488d-8ce0-608f07bdc385 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Flavor limits 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 11:40:40.726000 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-7e805348-6621-488d-8ce0-608f07bdc385 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Image limits 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 11:40:40.726643 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-7e805348-6621-488d-8ce0-608f07bdc385 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Flavor pref 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 11:40:40.727871 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-7e805348-6621-488d-8ce0-608f07bdc385 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Image pref 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 11:40:40.728344 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-7e805348-6621-488d-8ce0-608f07bdc385 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 11:40:40.755128 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7e805348-6621-488d-8ce0-608f07bdc385 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:40.759143 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7e805348-6621-488d-8ce0-608f07bdc385 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:40.759947 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7e805348-6621-488d-8ce0-608f07bdc385 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:40.761683 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7e805348-6621-488d-8ce0-608f07bdc385 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:40.762827 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7e805348-6621-488d-8ce0-608f07bdc385 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:40.767136 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7e805348-6621-488d-8ce0-608f07bdc385 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:40.795348 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.quota [None req-7e805348-6621-488d-8ce0-608f07bdc385 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Getting quotas for project ffc96760658d4e19af26d6cf22e94172. Resources: {'cores', 'instances', 'ram'} {{(pid=125485) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:40:40.800364 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.quota [None req-7e805348-6621-488d-8ce0-608f07bdc385 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Getting quotas for user bddd3d2bb8f647f2ba616141eb16622e and project ffc96760658d4e19af26d6cf22e94172. Resources: {'cores', 'instances', 'ram'} {{(pid=125485) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:40:40.817403 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-7e805348-6621-488d-8ce0-608f07bdc385 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Going to run 1 instances... {{(pid=125485) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 11:40:40.820144 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-7e805348-6621-488d-8ce0-608f07bdc385 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4917b56-ebe0-409a-894a-469900c12b94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125485) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 11:40:40.832123 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-a709c107-b227-49e1-ad63-6acd6f3ec185 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Flavor limits 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 11:40:40.832568 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-a709c107-b227-49e1-ad63-6acd6f3ec185 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Image limits 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 11:40:40.833082 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-a709c107-b227-49e1-ad63-6acd6f3ec185 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Flavor pref 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 11:40:40.833589 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-a709c107-b227-49e1-ad63-6acd6f3ec185 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Image pref 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 11:40:40.834120 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-a709c107-b227-49e1-ad63-6acd6f3ec185 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 11:40:40.862464 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a709c107-b227-49e1-ad63-6acd6f3ec185 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:40.863511 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a709c107-b227-49e1-ad63-6acd6f3ec185 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:40.864104 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a709c107-b227-49e1-ad63-6acd6f3ec185 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:40.866038 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a709c107-b227-49e1-ad63-6acd6f3ec185 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:40.866806 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a709c107-b227-49e1-ad63-6acd6f3ec185 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:40.868234 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a709c107-b227-49e1-ad63-6acd6f3ec185 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:40.892118 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-7e805348-6621-488d-8ce0-608f07bdc385 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.832525 Oct 18 11:40:40.894986 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 20/34] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Oct 18 11:40:38 2022] POST /compute/v2.1/servers => generated 400 bytes in 2836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 11:40:40.907196 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-60c72a5d-d240-4008-ba2a-0e42ec50b67c tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:40.910855 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-60c72a5d-d240-4008-ba2a-0e42ec50b67c tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:40.923913 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-60c72a5d-d240-4008-ba2a-0e42ec50b67c tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:40.925160 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-60c72a5d-d240-4008-ba2a-0e42ec50b67c tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:40.926364 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-60c72a5d-d240-4008-ba2a-0e42ec50b67c tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:40.927412 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-60c72a5d-d240-4008-ba2a-0e42ec50b67c tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:40.927699 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-a709c107-b227-49e1-ad63-6acd6f3ec185 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Getting quotas for project cd52252f24114465af9bdf6e6fe68b76. Resources: {'cores', 'instances', 'ram'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:40:40.928867 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-60c72a5d-d240-4008-ba2a-0e42ec50b67c tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:40.929509 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-60c72a5d-d240-4008-ba2a-0e42ec50b67c tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:40.958223 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-a709c107-b227-49e1-ad63-6acd6f3ec185 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Getting quotas for user 1f624c36a3574b61bd17d5d73af71916 and project cd52252f24114465af9bdf6e6fe68b76. Resources: {'cores', 'instances', 'ram'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:40:40.977357 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-a709c107-b227-49e1-ad63-6acd6f3ec185 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Going to run 1 instances... {{(pid=125486) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 11:40:40.979976 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-a709c107-b227-49e1-ad63-6acd6f3ec185 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4917b56-ebe0-409a-894a-469900c12b94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 11:40:41.086182 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-a709c107-b227-49e1-ad63-6acd6f3ec185 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.504976 Oct 18 11:40:41.091721 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 15/35] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Oct 18 11:40:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 1511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 11:40:41.100324 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-b64a6132-3f24-458d-b276-f265af45f33e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:41.107147 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-b64a6132-3f24-458d-b276-f265af45f33e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:41.308648 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-b64a6132-3f24-458d-b276-f265af45f33e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:41.327752 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-b64a6132-3f24-458d-b276-f265af45f33e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1237 microversion: 2.1 time: 0.230068 Oct 18 11:40:41.329603 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 16/36] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:41 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1237 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:41.368264 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-580789f0-61cf-4da6-96f4-33fdc9b8739e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:41.374580 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-60c72a5d-d240-4008-ba2a-0e42ec50b67c tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc074aee7d427bb0336fd19d31ef9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c580418dbc24525b6631dcd0a5f7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:41.389771 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-580789f0-61cf-4da6-96f4-33fdc9b8739e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:41.399869 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-60c72a5d-d240-4008-ba2a-0e42ec50b67c tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] 10.222.0.17 "GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33" status: 200 len: 1211 microversion: 2.1 time: 0.503666 Oct 18 11:40:41.419590 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 21/37] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:40 2022] GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33 => generated 1211 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:41.534133 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-580789f0-61cf-4da6-96f4-33fdc9b8739e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:41.566654 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-580789f0-61cf-4da6-96f4-33fdc9b8739e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1221 microversion: 2.1 time: 0.233436 Oct 18 11:40:41.585521 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 17/38] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:41 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1221 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:42.362121 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-26236a18-a068-48c3-8465-ec05f0c55ebd tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:42.365539 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-26236a18-a068-48c3-8465-ec05f0c55ebd tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:42.381393 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-26236a18-a068-48c3-8465-ec05f0c55ebd tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:42.389545 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-26236a18-a068-48c3-8465-ec05f0c55ebd tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:42.390963 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-26236a18-a068-48c3-8465-ec05f0c55ebd tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:42.394844 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-26236a18-a068-48c3-8465-ec05f0c55ebd tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:42.395698 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-26236a18-a068-48c3-8465-ec05f0c55ebd tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:42.396525 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-26236a18-a068-48c3-8465-ec05f0c55ebd tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:42.454215 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-cf7ff431-1646-4ec1-ad60-69d6de26abf3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:42.455509 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-cf7ff431-1646-4ec1-ad60-69d6de26abf3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:42.487343 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cf7ff431-1646-4ec1-ad60-69d6de26abf3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:42.495054 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cf7ff431-1646-4ec1-ad60-69d6de26abf3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:42.498670 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cf7ff431-1646-4ec1-ad60-69d6de26abf3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:42.499920 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cf7ff431-1646-4ec1-ad60-69d6de26abf3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:42.500410 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cf7ff431-1646-4ec1-ad60-69d6de26abf3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:42.505648 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cf7ff431-1646-4ec1-ad60-69d6de26abf3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:42.677320 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-26236a18-a068-48c3-8465-ec05f0c55ebd tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:42.692929 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-26236a18-a068-48c3-8465-ec05f0c55ebd tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1233 microversion: 2.1 time: 0.334686 Oct 18 11:40:42.693860 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 22/39] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:42 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1233 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:42.712029 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-83c7c499-44cc-47a7-add1-10bc295c6246 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:42.717307 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-83c7c499-44cc-47a7-add1-10bc295c6246 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:42.740521 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-83c7c499-44cc-47a7-add1-10bc295c6246 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:42.741310 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-83c7c499-44cc-47a7-add1-10bc295c6246 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:42.742292 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-83c7c499-44cc-47a7-add1-10bc295c6246 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:42.743220 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-83c7c499-44cc-47a7-add1-10bc295c6246 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:42.752290 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-83c7c499-44cc-47a7-add1-10bc295c6246 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:42.753918 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-83c7c499-44cc-47a7-add1-10bc295c6246 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:43.039067 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-83c7c499-44cc-47a7-add1-10bc295c6246 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:43.070292 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-83c7c499-44cc-47a7-add1-10bc295c6246 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1225 microversion: 2.1 time: 0.373899 Oct 18 11:40:43.071289 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 23/40] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:42 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1225 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:43.233691 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-cf7ff431-1646-4ec1-ad60-69d6de26abf3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc074aee7d427bb0336fd19d31ef9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c580418dbc24525b6631dcd0a5f7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:43.251820 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-cf7ff431-1646-4ec1-ad60-69d6de26abf3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] 10.222.0.17 "GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33" status: 200 len: 1267 microversion: 2.1 time: 0.808309 Oct 18 11:40:43.252422 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 18/41] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:42 2022] GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33 => generated 1267 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:43.722482 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-bd8e8677-3724-4beb-8a25-21ac0e3a6067 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:43.723797 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-bd8e8677-3724-4beb-8a25-21ac0e3a6067 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:43.732749 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bd8e8677-3724-4beb-8a25-21ac0e3a6067 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:43.735356 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bd8e8677-3724-4beb-8a25-21ac0e3a6067 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:43.738612 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bd8e8677-3724-4beb-8a25-21ac0e3a6067 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:43.739616 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bd8e8677-3724-4beb-8a25-21ac0e3a6067 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:43.745061 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bd8e8677-3724-4beb-8a25-21ac0e3a6067 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:43.745773 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bd8e8677-3724-4beb-8a25-21ac0e3a6067 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:43.808700 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-6e4ce8bd-a687-4c03-a990-0d6675ee6e49 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-811902553", "imageRef": "a4917b56-ebe0-409a-894a-469900c12b94", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb24f3be-68a7-4ca5-a331-f9f5950dbafd"}], "security_groups": [{"name": "tempest-securitygroup--346300301"}], "key_name": "tempest-keypair-1084490736", "user_data": "}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:40:43.957281 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-bd8e8677-3724-4beb-8a25-21ac0e3a6067 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:43.965683 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-bd8e8677-3724-4beb-8a25-21ac0e3a6067 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1289 microversion: 2.1 time: 0.247327 Oct 18 11:40:43.970905 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 24/42] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:43 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1289 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:44.095904 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-8380acc6-b20c-41f2-9cf4-33ed134d68c2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:44.096947 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-8380acc6-b20c-41f2-9cf4-33ed134d68c2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:44.113768 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8380acc6-b20c-41f2-9cf4-33ed134d68c2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:44.129330 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8380acc6-b20c-41f2-9cf4-33ed134d68c2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:44.129859 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8380acc6-b20c-41f2-9cf4-33ed134d68c2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:44.130621 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8380acc6-b20c-41f2-9cf4-33ed134d68c2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:44.139459 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8380acc6-b20c-41f2-9cf4-33ed134d68c2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:44.141534 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8380acc6-b20c-41f2-9cf4-33ed134d68c2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:44.228375 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.network.neutron [None req-6e4ce8bd-a687-4c03-a990-0d6675ee6e49 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] validate_networks() for [('eb24f3be-68a7-4ca5-a331-f9f5950dbafd', None, None, None, None, None)] {{(pid=125486) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 11:40:44.339424 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-8380acc6-b20c-41f2-9cf4-33ed134d68c2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:44.349396 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-8380acc6-b20c-41f2-9cf4-33ed134d68c2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1217 microversion: 2.1 time: 0.259289 Oct 18 11:40:44.350952 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 25/43] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:44 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1217 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:40:44.357394 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-7b04e806-4eb7-43bf-97ec-3edaee8bf772 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:44.358817 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-7b04e806-4eb7-43bf-97ec-3edaee8bf772 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:44.365721 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7b04e806-4eb7-43bf-97ec-3edaee8bf772 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:44.369904 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7b04e806-4eb7-43bf-97ec-3edaee8bf772 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:44.370662 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7b04e806-4eb7-43bf-97ec-3edaee8bf772 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:44.372355 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7b04e806-4eb7-43bf-97ec-3edaee8bf772 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:44.373076 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7b04e806-4eb7-43bf-97ec-3edaee8bf772 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:44.373690 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7b04e806-4eb7-43bf-97ec-3edaee8bf772 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:44.443165 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-7b04e806-4eb7-43bf-97ec-3edaee8bf772 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc074aee7d427bb0336fd19d31ef9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c580418dbc24525b6631dcd0a5f7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:44.454703 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-7b04e806-4eb7-43bf-97ec-3edaee8bf772 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] 10.222.0.17 "GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33" status: 200 len: 1273 microversion: 2.1 time: 0.102412 Oct 18 11:40:44.456049 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 26/44] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:44 2022] GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33 => generated 1273 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:44.998337 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-210c7dd3-0219-4619-ae84-e56fa46f4406 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:45.007054 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-210c7dd3-0219-4619-ae84-e56fa46f4406 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:45.042525 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-210c7dd3-0219-4619-ae84-e56fa46f4406 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:45.047134 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-210c7dd3-0219-4619-ae84-e56fa46f4406 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:45.050531 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-210c7dd3-0219-4619-ae84-e56fa46f4406 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:45.051520 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-210c7dd3-0219-4619-ae84-e56fa46f4406 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:45.057407 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-210c7dd3-0219-4619-ae84-e56fa46f4406 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:45.058453 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-210c7dd3-0219-4619-ae84-e56fa46f4406 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:45.279765 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-210c7dd3-0219-4619-ae84-e56fa46f4406 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:45.311850 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-210c7dd3-0219-4619-ae84-e56fa46f4406 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1295 microversion: 2.1 time: 0.322475 Oct 18 11:40:45.312384 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 27/45] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:44 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1295 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:45.376672 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-55d97bf2-0729-484f-b9cc-8cbca01422e4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:45.377497 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-55d97bf2-0729-484f-b9cc-8cbca01422e4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:45.386299 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-55d97bf2-0729-484f-b9cc-8cbca01422e4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:45.387428 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-55d97bf2-0729-484f-b9cc-8cbca01422e4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:45.388103 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-55d97bf2-0729-484f-b9cc-8cbca01422e4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:45.389635 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-55d97bf2-0729-484f-b9cc-8cbca01422e4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:45.390313 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-55d97bf2-0729-484f-b9cc-8cbca01422e4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:45.390930 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-55d97bf2-0729-484f-b9cc-8cbca01422e4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:45.741173 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-55d97bf2-0729-484f-b9cc-8cbca01422e4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:45.757707 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-55d97bf2-0729-484f-b9cc-8cbca01422e4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1217 microversion: 2.1 time: 0.385290 Oct 18 11:40:45.764475 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 28/46] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:45 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1217 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:40:45.774251 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-1364934b-6722-41e9-bf63-a6ea864a7f07 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:45.784629 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-1364934b-6722-41e9-bf63-a6ea864a7f07 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:45.803034 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1364934b-6722-41e9-bf63-a6ea864a7f07 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:45.810924 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1364934b-6722-41e9-bf63-a6ea864a7f07 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:45.811785 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1364934b-6722-41e9-bf63-a6ea864a7f07 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:45.815616 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1364934b-6722-41e9-bf63-a6ea864a7f07 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:45.816211 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1364934b-6722-41e9-bf63-a6ea864a7f07 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:45.820073 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1364934b-6722-41e9-bf63-a6ea864a7f07 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:46.274427 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-1364934b-6722-41e9-bf63-a6ea864a7f07 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc074aee7d427bb0336fd19d31ef9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c580418dbc24525b6631dcd0a5f7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:46.285801 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-1364934b-6722-41e9-bf63-a6ea864a7f07 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] 10.222.0.17 "GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33" status: 200 len: 1273 microversion: 2.1 time: 0.519593 Oct 18 11:40:46.294280 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 29/47] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:45 2022] GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33 => generated 1273 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:46.337691 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-593869cf-25b7-4c08-92a6-3cc652e283f2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:46.338657 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-593869cf-25b7-4c08-92a6-3cc652e283f2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:46.349176 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-6e4ce8bd-a687-4c03-a990-0d6675ee6e49 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Flavor limits 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 11:40:46.350353 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-6e4ce8bd-a687-4c03-a990-0d6675ee6e49 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Image limits 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 11:40:46.351894 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-6e4ce8bd-a687-4c03-a990-0d6675ee6e49 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Flavor pref 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 11:40:46.353505 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-6e4ce8bd-a687-4c03-a990-0d6675ee6e49 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Image pref 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 11:40:46.354491 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-6e4ce8bd-a687-4c03-a990-0d6675ee6e49 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 11:40:46.368155 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-593869cf-25b7-4c08-92a6-3cc652e283f2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:46.368951 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-593869cf-25b7-4c08-92a6-3cc652e283f2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:46.369648 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-593869cf-25b7-4c08-92a6-3cc652e283f2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:46.377397 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-593869cf-25b7-4c08-92a6-3cc652e283f2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:46.378257 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-593869cf-25b7-4c08-92a6-3cc652e283f2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:46.378912 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-593869cf-25b7-4c08-92a6-3cc652e283f2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:46.391178 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6e4ce8bd-a687-4c03-a990-0d6675ee6e49 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:46.393275 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6e4ce8bd-a687-4c03-a990-0d6675ee6e49 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:46.398661 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6e4ce8bd-a687-4c03-a990-0d6675ee6e49 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:46.400663 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6e4ce8bd-a687-4c03-a990-0d6675ee6e49 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:46.402141 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6e4ce8bd-a687-4c03-a990-0d6675ee6e49 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:46.404280 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6e4ce8bd-a687-4c03-a990-0d6675ee6e49 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:46.518019 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-6e4ce8bd-a687-4c03-a990-0d6675ee6e49 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Getting quotas for project 633afaabbbff47a4a99ebc997e67b01a. Resources: {'cores', 'instances', 'ram'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:40:46.528037 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-6e4ce8bd-a687-4c03-a990-0d6675ee6e49 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Getting quotas for user 916699a212eb4d8aa945f299ac0d4c96 and project 633afaabbbff47a4a99ebc997e67b01a. Resources: {'cores', 'instances', 'ram'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:40:46.577869 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-6e4ce8bd-a687-4c03-a990-0d6675ee6e49 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Going to run 1 instances... {{(pid=125486) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 11:40:46.587564 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-6e4ce8bd-a687-4c03-a990-0d6675ee6e49 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4917b56-ebe0-409a-894a-469900c12b94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 11:40:46.768799 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-6e4ce8bd-a687-4c03-a990-0d6675ee6e49 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.954193 Oct 18 11:40:46.780463 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 19/48] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Oct 18 11:40:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 2977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 11:40:46.806197 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-993a1958-5f5d-4af3-9a31-d9afbf851e8c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:46.807042 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-993a1958-5f5d-4af3-9a31-d9afbf851e8c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:46.914673 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-593869cf-25b7-4c08-92a6-3cc652e283f2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:46.923207 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-593869cf-25b7-4c08-92a6-3cc652e283f2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1295 microversion: 2.1 time: 0.589290 Oct 18 11:40:46.923813 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 30/49] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:46 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1295 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:40:46.944516 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-bc53309e-5a2e-40be-b68c-30e56300c6ce tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:46.971302 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-bc53309e-5a2e-40be-b68c-30e56300c6ce tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:47.009937 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bc53309e-5a2e-40be-b68c-30e56300c6ce tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:47.010639 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bc53309e-5a2e-40be-b68c-30e56300c6ce tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:47.011332 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bc53309e-5a2e-40be-b68c-30e56300c6ce tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:47.024562 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bc53309e-5a2e-40be-b68c-30e56300c6ce tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:47.031946 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bc53309e-5a2e-40be-b68c-30e56300c6ce tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:47.032767 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bc53309e-5a2e-40be-b68c-30e56300c6ce tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:47.415837 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-993a1958-5f5d-4af3-9a31-d9afbf851e8c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:47.441028 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-993a1958-5f5d-4af3-9a31-d9afbf851e8c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13" status: 200 len: 1241 microversion: 2.1 time: 0.653634 Oct 18 11:40:47.441661 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 20/50] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:46 2022] GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13 => generated 1241 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:47.452336 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-5db37d9d-eb45-4be8-bfcf-ff8ea86c6e41 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:47.467650 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-5db37d9d-eb45-4be8-bfcf-ff8ea86c6e41 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:47.518888 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5db37d9d-eb45-4be8-bfcf-ff8ea86c6e41 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:47.520419 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5db37d9d-eb45-4be8-bfcf-ff8ea86c6e41 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:47.523529 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5db37d9d-eb45-4be8-bfcf-ff8ea86c6e41 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:47.526788 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5db37d9d-eb45-4be8-bfcf-ff8ea86c6e41 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:47.530158 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5db37d9d-eb45-4be8-bfcf-ff8ea86c6e41 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:47.535014 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5db37d9d-eb45-4be8-bfcf-ff8ea86c6e41 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:47.543445 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-bc53309e-5a2e-40be-b68c-30e56300c6ce tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:47.561407 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-bc53309e-5a2e-40be-b68c-30e56300c6ce tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1281 microversion: 2.1 time: 0.636427 Oct 18 11:40:47.566522 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 31/51] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:46 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1281 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:47.946999 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-05d4a10b-fa20-4884-b1e4-4ceda076fab0 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:47.947923 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-05d4a10b-fa20-4884-b1e4-4ceda076fab0 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:47.960079 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-05d4a10b-fa20-4884-b1e4-4ceda076fab0 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:47.973219 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-05d4a10b-fa20-4884-b1e4-4ceda076fab0 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:47.973219 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-05d4a10b-fa20-4884-b1e4-4ceda076fab0 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:47.973219 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-05d4a10b-fa20-4884-b1e4-4ceda076fab0 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:47.974526 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-05d4a10b-fa20-4884-b1e4-4ceda076fab0 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:47.974975 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-05d4a10b-fa20-4884-b1e4-4ceda076fab0 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:48.261218 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-05d4a10b-fa20-4884-b1e4-4ceda076fab0 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:48.272046 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-05d4a10b-fa20-4884-b1e4-4ceda076fab0 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1295 microversion: 2.1 time: 0.328955 Oct 18 11:40:48.278217 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 32/52] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:47 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1295 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:40:48.464793 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-67512377-4339-408d-93ae-7a088c8eaedd tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:48.466434 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-67512377-4339-408d-93ae-7a088c8eaedd tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:48.469249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=8 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:40:48.485875 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-67512377-4339-408d-93ae-7a088c8eaedd tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:48.497940 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-67512377-4339-408d-93ae-7a088c8eaedd tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:48.504673 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-67512377-4339-408d-93ae-7a088c8eaedd tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:48.505816 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-67512377-4339-408d-93ae-7a088c8eaedd tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:48.506542 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-67512377-4339-408d-93ae-7a088c8eaedd tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:48.509253 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-67512377-4339-408d-93ae-7a088c8eaedd tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:48.772064 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-5db37d9d-eb45-4be8-bfcf-ff8ea86c6e41 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc074aee7d427bb0336fd19d31ef9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c580418dbc24525b6631dcd0a5f7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:48.787817 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-5db37d9d-eb45-4be8-bfcf-ff8ea86c6e41 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] 10.222.0.17 "GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33" status: 200 len: 1273 microversion: 2.1 time: 1.342404 Oct 18 11:40:48.799187 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 21/53] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:47 2022] GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33 => generated 1273 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:48.803966 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-8136ab52-ee18-4133-880f-abea68065ae0 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:48.804590 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-8136ab52-ee18-4133-880f-abea68065ae0 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:48.833385 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8136ab52-ee18-4133-880f-abea68065ae0 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:48.835724 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8136ab52-ee18-4133-880f-abea68065ae0 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:48.837215 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8136ab52-ee18-4133-880f-abea68065ae0 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:48.838707 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8136ab52-ee18-4133-880f-abea68065ae0 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:48.841235 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8136ab52-ee18-4133-880f-abea68065ae0 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:48.842147 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8136ab52-ee18-4133-880f-abea68065ae0 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:49.093753 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-67512377-4339-408d-93ae-7a088c8eaedd tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:49.104114 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-67512377-4339-408d-93ae-7a088c8eaedd tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13" status: 200 len: 1237 microversion: 2.1 time: 0.644068 Oct 18 11:40:49.109708 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 33/54] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:48 2022] GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13 => generated 1237 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:40:49.302742 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-e916a46d-8ac7-4ab5-8a4f-357990235343 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:49.307266 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-e916a46d-8ac7-4ab5-8a4f-357990235343 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:49.320297 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e916a46d-8ac7-4ab5-8a4f-357990235343 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:49.324794 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e916a46d-8ac7-4ab5-8a4f-357990235343 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:49.326832 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e916a46d-8ac7-4ab5-8a4f-357990235343 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:49.327861 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e916a46d-8ac7-4ab5-8a4f-357990235343 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:49.332615 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e916a46d-8ac7-4ab5-8a4f-357990235343 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:49.334719 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e916a46d-8ac7-4ab5-8a4f-357990235343 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:49.491746 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-e916a46d-8ac7-4ab5-8a4f-357990235343 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:49.503990 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-e916a46d-8ac7-4ab5-8a4f-357990235343 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1295 microversion: 2.1 time: 0.205213 Oct 18 11:40:49.506314 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 34/55] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:49 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1295 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:49.537760 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-8136ab52-ee18-4133-880f-abea68065ae0 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:49.547353 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-8136ab52-ee18-4133-880f-abea68065ae0 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1279 microversion: 2.1 time: 0.747093 Oct 18 11:40:49.551886 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 22/56] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:48 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1279 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:49.815218 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-5a6a3956-381f-4f9b-b6b9-5731aea43a38 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:49.823087 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-5a6a3956-381f-4f9b-b6b9-5731aea43a38 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:49.844438 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5a6a3956-381f-4f9b-b6b9-5731aea43a38 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:49.845650 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5a6a3956-381f-4f9b-b6b9-5731aea43a38 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:49.846501 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5a6a3956-381f-4f9b-b6b9-5731aea43a38 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:49.847797 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5a6a3956-381f-4f9b-b6b9-5731aea43a38 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:49.848616 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5a6a3956-381f-4f9b-b6b9-5731aea43a38 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:49.857062 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5a6a3956-381f-4f9b-b6b9-5731aea43a38 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:50.134573 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-4451f219-c66b-40bc-a052-c8d4dd88d748 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:50.136193 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-4451f219-c66b-40bc-a052-c8d4dd88d748 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:50.148138 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4451f219-c66b-40bc-a052-c8d4dd88d748 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:50.149310 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4451f219-c66b-40bc-a052-c8d4dd88d748 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:50.150015 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4451f219-c66b-40bc-a052-c8d4dd88d748 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:50.150961 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4451f219-c66b-40bc-a052-c8d4dd88d748 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:50.152787 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4451f219-c66b-40bc-a052-c8d4dd88d748 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:50.154049 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4451f219-c66b-40bc-a052-c8d4dd88d748 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:50.573650 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-4451f219-c66b-40bc-a052-c8d4dd88d748 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:50.602647 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-4451f219-c66b-40bc-a052-c8d4dd88d748 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13" status: 200 len: 1301 microversion: 2.1 time: 0.470937 Oct 18 11:40:50.604913 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 23/57] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:50 2022] GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13 => generated 1301 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:50.644496 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-9c49a917-bdd3-4539-80eb-019a2555a3f6 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:50.645513 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-9c49a917-bdd3-4539-80eb-019a2555a3f6 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:50.668878 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9c49a917-bdd3-4539-80eb-019a2555a3f6 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:50.670774 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9c49a917-bdd3-4539-80eb-019a2555a3f6 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:50.674485 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9c49a917-bdd3-4539-80eb-019a2555a3f6 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:50.676166 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9c49a917-bdd3-4539-80eb-019a2555a3f6 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:50.686285 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9c49a917-bdd3-4539-80eb-019a2555a3f6 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:50.687416 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9c49a917-bdd3-4539-80eb-019a2555a3f6 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:50.753043 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-5a6a3956-381f-4f9b-b6b9-5731aea43a38 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc074aee7d427bb0336fd19d31ef9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c580418dbc24525b6631dcd0a5f7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:50.772801 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-5a6a3956-381f-4f9b-b6b9-5731aea43a38 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] 10.222.0.17 "GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33" status: 200 len: 1315 microversion: 2.1 time: 0.964514 Oct 18 11:40:50.778842 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 35/58] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:49 2022] GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33 => generated 1315 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:50.784979 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell0:SELECT=4 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:40:50.813914 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-8018e313-32f6-4bf9-94fd-ee8d1bd6442d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:50.814539 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-8018e313-32f6-4bf9-94fd-ee8d1bd6442d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:50.837425 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell0:SELECT=22 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:40:50.843083 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8018e313-32f6-4bf9-94fd-ee8d1bd6442d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:50.849345 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8018e313-32f6-4bf9-94fd-ee8d1bd6442d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:50.851531 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8018e313-32f6-4bf9-94fd-ee8d1bd6442d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:50.853424 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8018e313-32f6-4bf9-94fd-ee8d1bd6442d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:50.854129 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8018e313-32f6-4bf9-94fd-ee8d1bd6442d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:50.857877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8018e313-32f6-4bf9-94fd-ee8d1bd6442d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:51.056551 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-8018e313-32f6-4bf9-94fd-ee8d1bd6442d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:51.062175 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=100 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:40:51.076383 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-8018e313-32f6-4bf9-94fd-ee8d1bd6442d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1279 microversion: 2.1 time: 0.293222 Oct 18 11:40:51.089168 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 36/59] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:50 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1279 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:51.590445 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-9c49a917-bdd3-4539-80eb-019a2555a3f6 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:51.606231 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-9c49a917-bdd3-4539-80eb-019a2555a3f6 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1361 microversion: 2.1 time: 0.999137 Oct 18 11:40:51.607882 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 24/60] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:50 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1361 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:51.630694 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-08734e2d-1451-4913-ac99-e53590d046a3 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:51.631685 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-08734e2d-1451-4913-ac99-e53590d046a3 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:51.659556 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-08734e2d-1451-4913-ac99-e53590d046a3 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:51.662310 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-08734e2d-1451-4913-ac99-e53590d046a3 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:51.664194 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-08734e2d-1451-4913-ac99-e53590d046a3 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:51.669208 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-08734e2d-1451-4913-ac99-e53590d046a3 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:51.671791 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-08734e2d-1451-4913-ac99-e53590d046a3 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:51.675413 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-08734e2d-1451-4913-ac99-e53590d046a3 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:51.805328 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-e8be503e-dee3-4b3e-b81a-17ff981d3eed tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:51.806709 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-e8be503e-dee3-4b3e-b81a-17ff981d3eed tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:51.822867 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e8be503e-dee3-4b3e-b81a-17ff981d3eed tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:51.829330 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e8be503e-dee3-4b3e-b81a-17ff981d3eed tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:51.832451 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e8be503e-dee3-4b3e-b81a-17ff981d3eed tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:51.836204 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e8be503e-dee3-4b3e-b81a-17ff981d3eed tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:51.843330 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e8be503e-dee3-4b3e-b81a-17ff981d3eed tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:51.848047 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e8be503e-dee3-4b3e-b81a-17ff981d3eed tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:51.926180 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-08734e2d-1451-4913-ac99-e53590d046a3 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:51.942884 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-08734e2d-1451-4913-ac99-e53590d046a3 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13" status: 200 len: 1299 microversion: 2.1 time: 0.312756 Oct 18 11:40:51.945603 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 37/61] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:51 2022] GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13 => generated 1299 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:52.108480 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-6b4cb99c-b22e-407c-9c8b-f59ccd4ccad6 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:52.116499 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-6b4cb99c-b22e-407c-9c8b-f59ccd4ccad6 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:52.150515 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6b4cb99c-b22e-407c-9c8b-f59ccd4ccad6 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:52.151106 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6b4cb99c-b22e-407c-9c8b-f59ccd4ccad6 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:52.151642 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6b4cb99c-b22e-407c-9c8b-f59ccd4ccad6 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:52.152953 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6b4cb99c-b22e-407c-9c8b-f59ccd4ccad6 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:52.153415 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6b4cb99c-b22e-407c-9c8b-f59ccd4ccad6 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:52.153851 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6b4cb99c-b22e-407c-9c8b-f59ccd4ccad6 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:52.429224 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-6b4cb99c-b22e-407c-9c8b-f59ccd4ccad6 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:52.456869 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-6b4cb99c-b22e-407c-9c8b-f59ccd4ccad6 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1279 microversion: 2.1 time: 0.348965 Oct 18 11:40:52.473853 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 38/62] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:52 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1279 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:52.637888 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ada4bb33-5d0d-4c21-8e2d-0fbbb48efd2c tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:52.638863 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-ada4bb33-5d0d-4c21-8e2d-0fbbb48efd2c tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:52.647239 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ada4bb33-5d0d-4c21-8e2d-0fbbb48efd2c tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:52.648316 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ada4bb33-5d0d-4c21-8e2d-0fbbb48efd2c tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:52.649118 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ada4bb33-5d0d-4c21-8e2d-0fbbb48efd2c tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:52.650533 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ada4bb33-5d0d-4c21-8e2d-0fbbb48efd2c tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:52.657727 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ada4bb33-5d0d-4c21-8e2d-0fbbb48efd2c tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:52.658563 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ada4bb33-5d0d-4c21-8e2d-0fbbb48efd2c tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:52.811552 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-e8be503e-dee3-4b3e-b81a-17ff981d3eed tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc074aee7d427bb0336fd19d31ef9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c580418dbc24525b6631dcd0a5f7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:52.824790 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-e8be503e-dee3-4b3e-b81a-17ff981d3eed tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] 10.222.0.17 "GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33" status: 200 len: 1315 microversion: 2.1 time: 1.025510 Oct 18 11:40:52.839154 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 25/63] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:51 2022] GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33 => generated 1315 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:52.974307 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-9ac643d4-e2b1-43f2-8ab5-7e20e069c3c2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:52.976013 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-9ac643d4-e2b1-43f2-8ab5-7e20e069c3c2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:52.988565 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9ac643d4-e2b1-43f2-8ab5-7e20e069c3c2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:52.989878 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9ac643d4-e2b1-43f2-8ab5-7e20e069c3c2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:52.991977 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9ac643d4-e2b1-43f2-8ab5-7e20e069c3c2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:52.993066 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9ac643d4-e2b1-43f2-8ab5-7e20e069c3c2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:52.994916 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9ac643d4-e2b1-43f2-8ab5-7e20e069c3c2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:52.998451 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9ac643d4-e2b1-43f2-8ab5-7e20e069c3c2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:53.673111 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-ada4bb33-5d0d-4c21-8e2d-0fbbb48efd2c tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:53.682979 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-ada4bb33-5d0d-4c21-8e2d-0fbbb48efd2c tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1361 microversion: 2.1 time: 1.050299 Oct 18 11:40:53.697744 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 39/64] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:52 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1361 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:53.709319 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-a3ef8aee-4593-4209-844c-82e1a924b3a2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:53.710167 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-a3ef8aee-4593-4209-844c-82e1a924b3a2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:53.762827 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a3ef8aee-4593-4209-844c-82e1a924b3a2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:53.766790 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a3ef8aee-4593-4209-844c-82e1a924b3a2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:53.778377 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a3ef8aee-4593-4209-844c-82e1a924b3a2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:53.779521 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a3ef8aee-4593-4209-844c-82e1a924b3a2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:53.782614 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a3ef8aee-4593-4209-844c-82e1a924b3a2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:53.784438 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a3ef8aee-4593-4209-844c-82e1a924b3a2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:54.134825 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-9ac643d4-e2b1-43f2-8ab5-7e20e069c3c2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:54.143827 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-9ac643d4-e2b1-43f2-8ab5-7e20e069c3c2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13" status: 200 len: 1366 microversion: 2.1 time: 1.173979 Oct 18 11:40:54.144408 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 26/65] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:52 2022] GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13 => generated 1366 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:54.159298 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-112b294d-690d-4982-9aa4-c2aed4636eaa tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:54.161317 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-112b294d-690d-4982-9aa4-c2aed4636eaa tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:54.177363 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-112b294d-690d-4982-9aa4-c2aed4636eaa tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:54.180317 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-112b294d-690d-4982-9aa4-c2aed4636eaa tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:54.181036 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-112b294d-690d-4982-9aa4-c2aed4636eaa tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:54.182044 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-112b294d-690d-4982-9aa4-c2aed4636eaa tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:54.184051 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-112b294d-690d-4982-9aa4-c2aed4636eaa tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:54.184698 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-112b294d-690d-4982-9aa4-c2aed4636eaa tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:54.605150 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-a3ef8aee-4593-4209-844c-82e1a924b3a2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:54.615732 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-a3ef8aee-4593-4209-844c-82e1a924b3a2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1321 microversion: 2.1 time: 0.916625 Oct 18 11:40:54.632504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 40/66] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:53 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1321 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:54.720083 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-998f2498-32a9-45c9-a2f7-ca4a564f2299 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:54.720804 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-998f2498-32a9-45c9-a2f7-ca4a564f2299 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:54.732570 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-998f2498-32a9-45c9-a2f7-ca4a564f2299 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:54.733100 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-998f2498-32a9-45c9-a2f7-ca4a564f2299 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:54.733597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-998f2498-32a9-45c9-a2f7-ca4a564f2299 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:54.734429 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-998f2498-32a9-45c9-a2f7-ca4a564f2299 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:54.734973 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-998f2498-32a9-45c9-a2f7-ca4a564f2299 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:54.735459 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-998f2498-32a9-45c9-a2f7-ca4a564f2299 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:55.385343 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-112b294d-690d-4982-9aa4-c2aed4636eaa tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc074aee7d427bb0336fd19d31ef9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c580418dbc24525b6631dcd0a5f7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:55.396047 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-998f2498-32a9-45c9-a2f7-ca4a564f2299 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:55.404758 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-112b294d-690d-4982-9aa4-c2aed4636eaa tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] 10.222.0.17 "GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33" status: 200 len: 1315 microversion: 2.1 time: 1.255104 Oct 18 11:40:55.404932 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-998f2498-32a9-45c9-a2f7-ca4a564f2299 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1361 microversion: 2.1 time: 0.688761 Oct 18 11:40:55.412309 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 41/67] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:54 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1361 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:40:55.418629 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 27/68] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:54 2022] GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33 => generated 1315 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:55.425034 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-393fe4e4-b5a4-468d-83da-f50ebac982b5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:55.429229 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-393fe4e4-b5a4-468d-83da-f50ebac982b5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:55.447922 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-393fe4e4-b5a4-468d-83da-f50ebac982b5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:55.448417 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-393fe4e4-b5a4-468d-83da-f50ebac982b5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:55.449422 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-393fe4e4-b5a4-468d-83da-f50ebac982b5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:55.462013 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-393fe4e4-b5a4-468d-83da-f50ebac982b5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:55.462776 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-393fe4e4-b5a4-468d-83da-f50ebac982b5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:55.463363 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-393fe4e4-b5a4-468d-83da-f50ebac982b5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:55.643498 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-09886f1f-416a-4e34-aeb6-e73d3f42eba9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:55.646242 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-09886f1f-416a-4e34-aeb6-e73d3f42eba9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:55.671992 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-09886f1f-416a-4e34-aeb6-e73d3f42eba9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:55.677403 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-09886f1f-416a-4e34-aeb6-e73d3f42eba9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:55.685803 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-09886f1f-416a-4e34-aeb6-e73d3f42eba9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:55.687719 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-09886f1f-416a-4e34-aeb6-e73d3f42eba9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:55.689401 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-09886f1f-416a-4e34-aeb6-e73d3f42eba9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:55.696876 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-09886f1f-416a-4e34-aeb6-e73d3f42eba9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:56.362853 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-393fe4e4-b5a4-468d-83da-f50ebac982b5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:56.376298 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-393fe4e4-b5a4-468d-83da-f50ebac982b5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13" status: 200 len: 1366 microversion: 2.1 time: 0.962516 Oct 18 11:40:56.392870 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 42/69] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:55 2022] GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13 => generated 1366 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:56.474187 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell0:SELECT=6 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:40:57.198744 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-cdc728f6-8ce8-48c1-a3eb-97d8569873ad req-c6e92242-22a5-4b60-b9a8-027decd197b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96c06c00-7190-4ae9-a194-2d8f6123a781", "tag": "d593caa5-bbcf-4c0d-8fdd-619edf5a1057"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:40:57.238964 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-cdc728f6-8ce8-48c1-a3eb-97d8569873ad req-c6e92242-22a5-4b60-b9a8-027decd197b3 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:57.242500 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-cdc728f6-8ce8-48c1-a3eb-97d8569873ad req-c6e92242-22a5-4b60-b9a8-027decd197b3 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:57.243006 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-cdc728f6-8ce8-48c1-a3eb-97d8569873ad req-c6e92242-22a5-4b60-b9a8-027decd197b3 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:57.316005 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-09886f1f-416a-4e34-aeb6-e73d3f42eba9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:57.334869 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-09886f1f-416a-4e34-aeb6-e73d3f42eba9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1321 microversion: 2.1 time: 1.692890 Oct 18 11:40:57.338355 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 28/70] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:55 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1321 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:57.342205 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-cdc728f6-8ce8-48c1-a3eb-97d8569873ad req-c6e92242-22a5-4b60-b9a8-027decd197b3 service nova] Creating event network-changed:d593caa5-bbcf-4c0d-8fdd-619edf5a1057 for instance 96c06c00-7190-4ae9-a194-2d8f6123a781 on hv-cinder-81558 Oct 18 11:40:57.346893 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-cdc728f6-8ce8-48c1-a3eb-97d8569873ad req-c6e92242-22a5-4b60-b9a8-027decd197b3 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125485) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 11:40:57.350062 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-cdc728f6-8ce8-48c1-a3eb-97d8569873ad req-c6e92242-22a5-4b60-b9a8-027decd197b3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125485) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 11:40:57.354242 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7325ad9a-789f-4a81-98c3-a2e1cb69dd8e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:57.357238 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7325ad9a-789f-4a81-98c3-a2e1cb69dd8e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:57.358139 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7325ad9a-789f-4a81-98c3-a2e1cb69dd8e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:57.360871 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7325ad9a-789f-4a81-98c3-a2e1cb69dd8e None None] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:57.364225 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7325ad9a-789f-4a81-98c3-a2e1cb69dd8e None None] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:57.368643 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7325ad9a-789f-4a81-98c3-a2e1cb69dd8e None None] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:57.418308 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.compute.rpcapi [None req-7325ad9a-789f-4a81-98c3-a2e1cb69dd8e None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 18 11:40:57.424162 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7325ad9a-789f-4a81-98c3-a2e1cb69dd8e None None] Releasing lock "compute-rpcapi-router" {{(pid=125485) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 11:40:57.433747 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell0:SELECT=28 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:40:57.460317 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-7325ad9a-789f-4a81-98c3-a2e1cb69dd8e None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.065930 Oct 18 11:40:57.462030 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 43/71] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:40:57.484778 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-e4542add-89f0-4123-bb7b-25cd9571fc64 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:57.486268 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-e4542add-89f0-4123-bb7b-25cd9571fc64 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:57.510732 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e4542add-89f0-4123-bb7b-25cd9571fc64 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:57.511238 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e4542add-89f0-4123-bb7b-25cd9571fc64 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:57.511738 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e4542add-89f0-4123-bb7b-25cd9571fc64 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:57.512544 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e4542add-89f0-4123-bb7b-25cd9571fc64 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:57.518512 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e4542add-89f0-4123-bb7b-25cd9571fc64 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:57.519164 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e4542add-89f0-4123-bb7b-25cd9571fc64 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:57.892772 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-04742559-9b4e-43c6-b285-8ff46180b2e7 req-fc80108d-cbcd-4935-8b4c-b0b8932533c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff0b9b95-b26f-4259-b929-a54954198f33", "tag": "b153888a-e54c-4f9b-96aa-a53dabfdf901"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:40:57.900633 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=9 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:40:57.947907 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-e4542add-89f0-4123-bb7b-25cd9571fc64 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc074aee7d427bb0336fd19d31ef9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c580418dbc24525b6631dcd0a5f7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:57.948758 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-04742559-9b4e-43c6-b285-8ff46180b2e7 req-fc80108d-cbcd-4935-8b4c-b0b8932533c4 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:57.952704 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-04742559-9b4e-43c6-b285-8ff46180b2e7 req-fc80108d-cbcd-4935-8b4c-b0b8932533c4 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:57.953331 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-04742559-9b4e-43c6-b285-8ff46180b2e7 req-fc80108d-cbcd-4935-8b4c-b0b8932533c4 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:57.965396 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-e4542add-89f0-4123-bb7b-25cd9571fc64 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] 10.222.0.17 "GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33" status: 200 len: 1315 microversion: 2.1 time: 0.498091 Oct 18 11:40:57.969909 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 44/72] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:57 2022] GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33 => generated 1315 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:57.985092 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ee1dea28-b0db-4662-8e93-9ba9d29557cb tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:57.989192 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-ee1dea28-b0db-4662-8e93-9ba9d29557cb tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:58.013754 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ee1dea28-b0db-4662-8e93-9ba9d29557cb tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:58.018485 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ee1dea28-b0db-4662-8e93-9ba9d29557cb tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:58.018880 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ee1dea28-b0db-4662-8e93-9ba9d29557cb tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:58.019711 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ee1dea28-b0db-4662-8e93-9ba9d29557cb tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:58.024290 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ee1dea28-b0db-4662-8e93-9ba9d29557cb tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:58.029579 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ee1dea28-b0db-4662-8e93-9ba9d29557cb tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:58.054971 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-04742559-9b4e-43c6-b285-8ff46180b2e7 req-fc80108d-cbcd-4935-8b4c-b0b8932533c4 service nova] Creating event network-changed:b153888a-e54c-4f9b-96aa-a53dabfdf901 for instance ff0b9b95-b26f-4259-b929-a54954198f33 on hv-cinder-81558 Oct 18 11:40:58.056066 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-04742559-9b4e-43c6-b285-8ff46180b2e7 req-fc80108d-cbcd-4935-8b4c-b0b8932533c4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125486) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 11:40:58.056680 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-04742559-9b4e-43c6-b285-8ff46180b2e7 req-fc80108d-cbcd-4935-8b4c-b0b8932533c4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125486) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 11:40:58.058036 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-18fef723-8a08-4a48-845f-f6729fd41bc3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:58.061332 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-18fef723-8a08-4a48-845f-f6729fd41bc3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:58.064232 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-18fef723-8a08-4a48-845f-f6729fd41bc3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:58.066115 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-18fef723-8a08-4a48-845f-f6729fd41bc3 None None] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:58.066831 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-18fef723-8a08-4a48-845f-f6729fd41bc3 None None] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:58.070557 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-18fef723-8a08-4a48-845f-f6729fd41bc3 None None] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:58.093333 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.compute.rpcapi [None req-18fef723-8a08-4a48-845f-f6729fd41bc3 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 18 11:40:58.095534 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-18fef723-8a08-4a48-845f-f6729fd41bc3 None None] Releasing lock "compute-rpcapi-router" {{(pid=125486) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 11:40:58.126725 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-18fef723-8a08-4a48-845f-f6729fd41bc3 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.781611 Oct 18 11:40:58.127822 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 29/73] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:40:58.141081 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-00ed59b4-68b0-4200-ab15-88fe437dc6dc tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:58.141956 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-00ed59b4-68b0-4200-ab15-88fe437dc6dc tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:58.155187 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-00ed59b4-68b0-4200-ab15-88fe437dc6dc tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:58.161845 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-00ed59b4-68b0-4200-ab15-88fe437dc6dc tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:58.162474 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-00ed59b4-68b0-4200-ab15-88fe437dc6dc tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:58.163458 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-00ed59b4-68b0-4200-ab15-88fe437dc6dc tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:58.164160 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-00ed59b4-68b0-4200-ab15-88fe437dc6dc tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:58.164662 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-00ed59b4-68b0-4200-ab15-88fe437dc6dc tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:58.503648 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-ee1dea28-b0db-4662-8e93-9ba9d29557cb tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:58.515020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-ee1dea28-b0db-4662-8e93-9ba9d29557cb tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1361 microversion: 2.1 time: 0.543766 Oct 18 11:40:58.518875 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 45/74] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:57 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1361 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:58.536637 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-15e9a71e-3c80-4614-a600-6fde92fed749 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:58.540264 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-15e9a71e-3c80-4614-a600-6fde92fed749 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:58.571361 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-15e9a71e-3c80-4614-a600-6fde92fed749 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:58.571924 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-15e9a71e-3c80-4614-a600-6fde92fed749 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:58.573504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-15e9a71e-3c80-4614-a600-6fde92fed749 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:58.576331 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-15e9a71e-3c80-4614-a600-6fde92fed749 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:58.576932 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-15e9a71e-3c80-4614-a600-6fde92fed749 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:58.577408 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-15e9a71e-3c80-4614-a600-6fde92fed749 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:58.846609 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-00ed59b4-68b0-4200-ab15-88fe437dc6dc tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:58.855624 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-00ed59b4-68b0-4200-ab15-88fe437dc6dc tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13" status: 200 len: 1366 microversion: 2.1 time: 0.726316 Oct 18 11:40:58.858959 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 30/75] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:58 2022] GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13 => generated 1366 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:58.951905 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-15e9a71e-3c80-4614-a600-6fde92fed749 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:58.961709 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-15e9a71e-3c80-4614-a600-6fde92fed749 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1321 microversion: 2.1 time: 0.440918 Oct 18 11:40:58.965815 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 46/76] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:58 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1321 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:58.999122 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-0e18132e-536c-4d39-ab76-57df271c90f0 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:59.000035 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-0e18132e-536c-4d39-ab76-57df271c90f0 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:59.010956 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0e18132e-536c-4d39-ab76-57df271c90f0 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:59.012667 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0e18132e-536c-4d39-ab76-57df271c90f0 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:59.013296 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0e18132e-536c-4d39-ab76-57df271c90f0 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:59.017293 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0e18132e-536c-4d39-ab76-57df271c90f0 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:59.025141 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0e18132e-536c-4d39-ab76-57df271c90f0 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:59.025141 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0e18132e-536c-4d39-ab76-57df271c90f0 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:59.427666 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-0e18132e-536c-4d39-ab76-57df271c90f0 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc074aee7d427bb0336fd19d31ef9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c580418dbc24525b6631dcd0a5f7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:59.437636 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-0e18132e-536c-4d39-ab76-57df271c90f0 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] 10.222.0.17 "GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33" status: 200 len: 1315 microversion: 2.1 time: 0.445387 Oct 18 11:40:59.443195 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 31/77] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:58 2022] GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33 => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:59.547772 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-3af5abbf-a59c-4a3e-896f-dfec7ebfa18e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:59.549521 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-3af5abbf-a59c-4a3e-896f-dfec7ebfa18e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:59.562457 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3af5abbf-a59c-4a3e-896f-dfec7ebfa18e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:59.565117 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3af5abbf-a59c-4a3e-896f-dfec7ebfa18e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:59.566171 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3af5abbf-a59c-4a3e-896f-dfec7ebfa18e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:59.567946 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3af5abbf-a59c-4a3e-896f-dfec7ebfa18e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:59.576280 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-b34edabc-c71f-47a4-993d-bd6cffbc698d req-e297b690-c165-4db7-89e7-2940a7e650fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ede7abe-e470-4b36-83ed-cd28e0347ac8", "tag": "f8af432d-f3da-4a10-a4cd-7e455ecc405c"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:40:59.585743 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3af5abbf-a59c-4a3e-896f-dfec7ebfa18e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:59.590720 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3af5abbf-a59c-4a3e-896f-dfec7ebfa18e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:59.610885 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-b34edabc-c71f-47a4-993d-bd6cffbc698d req-e297b690-c165-4db7-89e7-2940a7e650fc service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:59.614254 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-b34edabc-c71f-47a4-993d-bd6cffbc698d req-e297b690-c165-4db7-89e7-2940a7e650fc service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:59.617023 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-b34edabc-c71f-47a4-993d-bd6cffbc698d req-e297b690-c165-4db7-89e7-2940a7e650fc service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:59.664299 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-b34edabc-c71f-47a4-993d-bd6cffbc698d req-e297b690-c165-4db7-89e7-2940a7e650fc service nova] Creating event network-changed:f8af432d-f3da-4a10-a4cd-7e455ecc405c for instance 4ede7abe-e470-4b36-83ed-cd28e0347ac8 on hv-cinder-81558 Oct 18 11:40:59.685849 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-b34edabc-c71f-47a4-993d-bd6cffbc698d req-e297b690-c165-4db7-89e7-2940a7e650fc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110258 Oct 18 11:40:59.686785 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 32/78] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:40:59.868958 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-3af5abbf-a59c-4a3e-896f-dfec7ebfa18e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:40:59.878711 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-3af5abbf-a59c-4a3e-896f-dfec7ebfa18e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1361 microversion: 2.1 time: 0.336586 Oct 18 11:40:59.886152 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-2eaea9af-9008-4452-aa56-1654359a0f5c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:59.891523 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 47/79] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:59 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1361 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:40:59.892883 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-2eaea9af-9008-4452-aa56-1654359a0f5c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:40:59.901167 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2eaea9af-9008-4452-aa56-1654359a0f5c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:59.902383 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2eaea9af-9008-4452-aa56-1654359a0f5c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:59.903259 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2eaea9af-9008-4452-aa56-1654359a0f5c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:59.904618 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2eaea9af-9008-4452-aa56-1654359a0f5c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:40:59.905626 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2eaea9af-9008-4452-aa56-1654359a0f5c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:40:59.906197 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2eaea9af-9008-4452-aa56-1654359a0f5c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:40:59.990098 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-87f6b05c-a336-4924-8a37-20f356461847 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:40:59.990713 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-87f6b05c-a336-4924-8a37-20f356461847 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:00.008528 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-87f6b05c-a336-4924-8a37-20f356461847 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:00.008920 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-87f6b05c-a336-4924-8a37-20f356461847 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:00.009358 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-87f6b05c-a336-4924-8a37-20f356461847 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:00.021380 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-87f6b05c-a336-4924-8a37-20f356461847 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:00.021906 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-87f6b05c-a336-4924-8a37-20f356461847 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:00.022366 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-87f6b05c-a336-4924-8a37-20f356461847 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:00.093930 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-2eaea9af-9008-4452-aa56-1654359a0f5c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:00.108222 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-2eaea9af-9008-4452-aa56-1654359a0f5c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13" status: 200 len: 1366 microversion: 2.1 time: 0.227469 Oct 18 11:41:00.110776 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 33/80] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:59 2022] GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:00.186504 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-00af1848-edaf-4406-875c-43d7b3954256 req-adce946c-9938-4c2f-afe6-99b860a37c2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3ed125b-4ca6-484d-9da6-d6e46fba2a13", "tag": "d543b925-1dd1-417b-8252-8a6c6aa87525"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:41:00.200771 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-00af1848-edaf-4406-875c-43d7b3954256 req-adce946c-9938-4c2f-afe6-99b860a37c2a service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:00.201874 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-00af1848-edaf-4406-875c-43d7b3954256 req-adce946c-9938-4c2f-afe6-99b860a37c2a service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:00.202666 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-00af1848-edaf-4406-875c-43d7b3954256 req-adce946c-9938-4c2f-afe6-99b860a37c2a service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:00.217817 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-00af1848-edaf-4406-875c-43d7b3954256 req-adce946c-9938-4c2f-afe6-99b860a37c2a service nova] Creating event network-changed:d543b925-1dd1-417b-8252-8a6c6aa87525 for instance b3ed125b-4ca6-484d-9da6-d6e46fba2a13 on hv-cinder-81558 Oct 18 11:41:00.228233 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-00af1848-edaf-4406-875c-43d7b3954256 req-adce946c-9938-4c2f-afe6-99b860a37c2a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065383 Oct 18 11:41:00.229507 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 34/81] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:41:00.369090 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-87f6b05c-a336-4924-8a37-20f356461847 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:00.400827 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-87f6b05c-a336-4924-8a37-20f356461847 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1321 microversion: 2.1 time: 0.413787 Oct 18 11:41:00.402125 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 48/82] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:40:59 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1321 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:41:00.465223 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-d9d0b928-97dd-4ea5-951e-295957cde783 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:00.465833 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-d9d0b928-97dd-4ea5-951e-295957cde783 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:00.472887 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d9d0b928-97dd-4ea5-951e-295957cde783 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:00.473517 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d9d0b928-97dd-4ea5-951e-295957cde783 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:00.474192 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d9d0b928-97dd-4ea5-951e-295957cde783 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:00.475154 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d9d0b928-97dd-4ea5-951e-295957cde783 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:00.475746 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d9d0b928-97dd-4ea5-951e-295957cde783 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:00.476315 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d9d0b928-97dd-4ea5-951e-295957cde783 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:00.656053 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-d9d0b928-97dd-4ea5-951e-295957cde783 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc074aee7d427bb0336fd19d31ef9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c580418dbc24525b6631dcd0a5f7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:00.669856 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-d9d0b928-97dd-4ea5-951e-295957cde783 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] 10.222.0.17 "GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33" status: 200 len: 1315 microversion: 2.1 time: 0.209909 Oct 18 11:41:00.670647 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 35/83] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:00 2022] GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:00.903424 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-0e4a7e28-3686-48a6-84bb-74e9ed1703fe tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:00.905049 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-0e4a7e28-3686-48a6-84bb-74e9ed1703fe tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:00.912427 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0e4a7e28-3686-48a6-84bb-74e9ed1703fe tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:00.912983 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0e4a7e28-3686-48a6-84bb-74e9ed1703fe tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:00.913613 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0e4a7e28-3686-48a6-84bb-74e9ed1703fe tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:00.914151 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0e4a7e28-3686-48a6-84bb-74e9ed1703fe tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:00.914581 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0e4a7e28-3686-48a6-84bb-74e9ed1703fe tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:00.915032 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0e4a7e28-3686-48a6-84bb-74e9ed1703fe tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:01.133279 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-f939a546-e742-4cc4-a725-95bfe7a5fc88 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:01.134040 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-f939a546-e742-4cc4-a725-95bfe7a5fc88 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:01.143059 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f939a546-e742-4cc4-a725-95bfe7a5fc88 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:01.143225 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-0e4a7e28-3686-48a6-84bb-74e9ed1703fe tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:01.144166 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f939a546-e742-4cc4-a725-95bfe7a5fc88 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:01.146036 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f939a546-e742-4cc4-a725-95bfe7a5fc88 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:01.147297 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f939a546-e742-4cc4-a725-95bfe7a5fc88 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:01.148209 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f939a546-e742-4cc4-a725-95bfe7a5fc88 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:01.149190 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f939a546-e742-4cc4-a725-95bfe7a5fc88 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:01.156790 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-0e4a7e28-3686-48a6-84bb-74e9ed1703fe tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1361 microversion: 2.1 time: 0.258321 Oct 18 11:41:01.172868 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 49/84] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:00 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1361 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:41:01.429933 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-8ef8b5ef-d337-4797-a05f-58b47d636037 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:01.431101 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-8ef8b5ef-d337-4797-a05f-58b47d636037 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:01.441509 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8ef8b5ef-d337-4797-a05f-58b47d636037 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:01.442559 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8ef8b5ef-d337-4797-a05f-58b47d636037 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:01.443181 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8ef8b5ef-d337-4797-a05f-58b47d636037 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:01.445731 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8ef8b5ef-d337-4797-a05f-58b47d636037 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:01.446544 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8ef8b5ef-d337-4797-a05f-58b47d636037 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:01.447237 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8ef8b5ef-d337-4797-a05f-58b47d636037 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:01.773244 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-f939a546-e742-4cc4-a725-95bfe7a5fc88 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:01.782368 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-f939a546-e742-4cc4-a725-95bfe7a5fc88 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13" status: 200 len: 1366 microversion: 2.1 time: 0.652791 Oct 18 11:41:01.782955 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 36/85] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:01 2022] GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13 => generated 1366 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:41:01.798163 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-c19ecae4-2498-4497-af1f-70a114b23b2a tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:01.798959 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-c19ecae4-2498-4497-af1f-70a114b23b2a tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:01.812675 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c19ecae4-2498-4497-af1f-70a114b23b2a tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:01.813209 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c19ecae4-2498-4497-af1f-70a114b23b2a tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:01.813645 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c19ecae4-2498-4497-af1f-70a114b23b2a tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:01.814349 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c19ecae4-2498-4497-af1f-70a114b23b2a tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:01.814797 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c19ecae4-2498-4497-af1f-70a114b23b2a tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:01.820283 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c19ecae4-2498-4497-af1f-70a114b23b2a tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:01.825176 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell1:SELECT=100 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:41:02.260544 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-8ef8b5ef-d337-4797-a05f-58b47d636037 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:02.278467 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-8ef8b5ef-d337-4797-a05f-58b47d636037 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1321 microversion: 2.1 time: 0.854844 Oct 18 11:41:02.280324 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 50/86] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:01 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1321 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:02.296514 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-9abc3e14-6048-4bc5-a04e-fc8d06e031d3 req-ff61e482-9992-4dd4-9bd1-3417f52e6793 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "774e4e5d-2e5c-40f1-943e-cb9bfd39738b", "tag": "79c25e94-9586-406b-90b5-8070148e296f"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:41:02.332412 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-9abc3e14-6048-4bc5-a04e-fc8d06e031d3 req-ff61e482-9992-4dd4-9bd1-3417f52e6793 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:02.335447 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-9abc3e14-6048-4bc5-a04e-fc8d06e031d3 req-ff61e482-9992-4dd4-9bd1-3417f52e6793 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:02.336351 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-9abc3e14-6048-4bc5-a04e-fc8d06e031d3 req-ff61e482-9992-4dd4-9bd1-3417f52e6793 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:02.355462 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-9abc3e14-6048-4bc5-a04e-fc8d06e031d3 req-ff61e482-9992-4dd4-9bd1-3417f52e6793 service nova] Creating event network-changed:79c25e94-9586-406b-90b5-8070148e296f for instance 774e4e5d-2e5c-40f1-943e-cb9bfd39738b on hv-cinder-81558 Oct 18 11:41:02.365763 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-9abc3e14-6048-4bc5-a04e-fc8d06e031d3 req-ff61e482-9992-4dd4-9bd1-3417f52e6793 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083762 Oct 18 11:41:02.366879 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 51/87] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:41:02.373627 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-23046ea5-cc79-4dfa-a4d8-cf3bb2e03135 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:02.374550 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-23046ea5-cc79-4dfa-a4d8-cf3bb2e03135 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:02.382018 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-23046ea5-cc79-4dfa-a4d8-cf3bb2e03135 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:02.382835 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-23046ea5-cc79-4dfa-a4d8-cf3bb2e03135 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:02.383455 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-23046ea5-cc79-4dfa-a4d8-cf3bb2e03135 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:02.384171 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-23046ea5-cc79-4dfa-a4d8-cf3bb2e03135 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:02.384616 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-23046ea5-cc79-4dfa-a4d8-cf3bb2e03135 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:02.385439 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-23046ea5-cc79-4dfa-a4d8-cf3bb2e03135 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:02.561365 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-c19ecae4-2498-4497-af1f-70a114b23b2a tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc074aee7d427bb0336fd19d31ef9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c580418dbc24525b6631dcd0a5f7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:02.587399 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-c19ecae4-2498-4497-af1f-70a114b23b2a tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] 10.222.0.17 "GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33" status: 200 len: 1315 microversion: 2.1 time: 0.784832 Oct 18 11:41:02.601259 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 37/88] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:01 2022] GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33 => generated 1315 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:02.813246 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-33a94cb3-7c32-4729-8513-cec5ea9cab02 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:02.813868 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-33a94cb3-7c32-4729-8513-cec5ea9cab02 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:02.826808 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-33a94cb3-7c32-4729-8513-cec5ea9cab02 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:02.827418 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-33a94cb3-7c32-4729-8513-cec5ea9cab02 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:02.827743 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-33a94cb3-7c32-4729-8513-cec5ea9cab02 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:02.828463 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-33a94cb3-7c32-4729-8513-cec5ea9cab02 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:02.828942 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-33a94cb3-7c32-4729-8513-cec5ea9cab02 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:02.829371 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-33a94cb3-7c32-4729-8513-cec5ea9cab02 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:02.848978 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-23046ea5-cc79-4dfa-a4d8-cf3bb2e03135 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:02.857661 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-23046ea5-cc79-4dfa-a4d8-cf3bb2e03135 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1361 microversion: 2.1 time: 0.489254 Oct 18 11:41:02.858455 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 52/89] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:02 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1361 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:03.019253 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-33a94cb3-7c32-4729-8513-cec5ea9cab02 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:03.028076 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-33a94cb3-7c32-4729-8513-cec5ea9cab02 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13" status: 200 len: 1366 microversion: 2.1 time: 0.220828 Oct 18 11:41:03.028659 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 38/90] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:02 2022] GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:03.304056 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-64a41b17-09ee-427c-8e54-430998d1c3e9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:03.305582 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-64a41b17-09ee-427c-8e54-430998d1c3e9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:03.318539 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-64a41b17-09ee-427c-8e54-430998d1c3e9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:03.320093 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-64a41b17-09ee-427c-8e54-430998d1c3e9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:03.320611 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-64a41b17-09ee-427c-8e54-430998d1c3e9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:03.324053 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-64a41b17-09ee-427c-8e54-430998d1c3e9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:03.325982 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-64a41b17-09ee-427c-8e54-430998d1c3e9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:03.326469 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-64a41b17-09ee-427c-8e54-430998d1c3e9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:03.582543 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-64a41b17-09ee-427c-8e54-430998d1c3e9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:03.599088 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-64a41b17-09ee-427c-8e54-430998d1c3e9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1321 microversion: 2.1 time: 0.299257 Oct 18 11:41:03.618907 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 53/91] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:03 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1321 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:03.623471 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-589812f0-3649-4c94-8102-be6fd6ee38a3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:03.627262 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-589812f0-3649-4c94-8102-be6fd6ee38a3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:03.640662 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-589812f0-3649-4c94-8102-be6fd6ee38a3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:03.644348 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-589812f0-3649-4c94-8102-be6fd6ee38a3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:03.644797 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-589812f0-3649-4c94-8102-be6fd6ee38a3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:03.645546 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-589812f0-3649-4c94-8102-be6fd6ee38a3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:03.647550 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-589812f0-3649-4c94-8102-be6fd6ee38a3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:03.649351 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-589812f0-3649-4c94-8102-be6fd6ee38a3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:03.883562 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-c651feda-25a0-4ec6-849b-5bfb406a9bb9 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:03.884698 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-c651feda-25a0-4ec6-849b-5bfb406a9bb9 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:03.895071 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c651feda-25a0-4ec6-849b-5bfb406a9bb9 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:03.895514 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-589812f0-3649-4c94-8102-be6fd6ee38a3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc074aee7d427bb0336fd19d31ef9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c580418dbc24525b6631dcd0a5f7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:03.895714 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c651feda-25a0-4ec6-849b-5bfb406a9bb9 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:03.896186 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c651feda-25a0-4ec6-849b-5bfb406a9bb9 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:03.897009 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c651feda-25a0-4ec6-849b-5bfb406a9bb9 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:03.902013 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c651feda-25a0-4ec6-849b-5bfb406a9bb9 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:03.902975 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c651feda-25a0-4ec6-849b-5bfb406a9bb9 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:03.910541 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-589812f0-3649-4c94-8102-be6fd6ee38a3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] 10.222.0.17 "GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33" status: 200 len: 1315 microversion: 2.1 time: 0.294604 Oct 18 11:41:03.917973 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 39/92] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:03 2022] GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:03.950595 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=100 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:41:04.050646 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-428e8cfa-2246-4600-956e-35b86b9e70d6 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:04.051369 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-428e8cfa-2246-4600-956e-35b86b9e70d6 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:04.058548 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-428e8cfa-2246-4600-956e-35b86b9e70d6 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:04.061544 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-428e8cfa-2246-4600-956e-35b86b9e70d6 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:04.062176 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-428e8cfa-2246-4600-956e-35b86b9e70d6 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:04.063069 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-428e8cfa-2246-4600-956e-35b86b9e70d6 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:04.063534 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-428e8cfa-2246-4600-956e-35b86b9e70d6 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:04.063948 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-428e8cfa-2246-4600-956e-35b86b9e70d6 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:04.155763 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-c651feda-25a0-4ec6-849b-5bfb406a9bb9 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:04.169418 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-c651feda-25a0-4ec6-849b-5bfb406a9bb9 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1361 microversion: 2.1 time: 0.290510 Oct 18 11:41:04.170994 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 54/93] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:03 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1361 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:41:04.290600 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-428e8cfa-2246-4600-956e-35b86b9e70d6 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:04.299374 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-428e8cfa-2246-4600-956e-35b86b9e70d6 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13" status: 200 len: 1366 microversion: 2.1 time: 0.252690 Oct 18 11:41:04.299951 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 40/94] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:04 2022] GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:41:04.629884 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-212c9ea9-38ef-428e-848b-5bea21e0911e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:04.630813 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-212c9ea9-38ef-428e-848b-5bea21e0911e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:04.641486 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-212c9ea9-38ef-428e-848b-5bea21e0911e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:04.641985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-212c9ea9-38ef-428e-848b-5bea21e0911e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:04.642426 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-212c9ea9-38ef-428e-848b-5bea21e0911e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:04.647228 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-212c9ea9-38ef-428e-848b-5bea21e0911e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:04.650877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-212c9ea9-38ef-428e-848b-5bea21e0911e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:04.652674 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-212c9ea9-38ef-428e-848b-5bea21e0911e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:04.937131 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-69a0c8de-82d6-43de-a276-feebec60b990 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:04.938653 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-69a0c8de-82d6-43de-a276-feebec60b990 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:04.950424 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-69a0c8de-82d6-43de-a276-feebec60b990 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:04.953079 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-69a0c8de-82d6-43de-a276-feebec60b990 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:04.953535 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-69a0c8de-82d6-43de-a276-feebec60b990 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:04.954256 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-69a0c8de-82d6-43de-a276-feebec60b990 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:04.954715 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-69a0c8de-82d6-43de-a276-feebec60b990 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:04.955139 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-69a0c8de-82d6-43de-a276-feebec60b990 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:05.257523 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-212c9ea9-38ef-428e-848b-5bea21e0911e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:05.271035 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-212c9ea9-38ef-428e-848b-5bea21e0911e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1321 microversion: 2.1 time: 0.647410 Oct 18 11:41:05.272408 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 55/95] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:04 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1321 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:05.289474 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-036a4c8f-2daa-457b-84ab-9f40f979bd00 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:05.290246 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-036a4c8f-2daa-457b-84ab-9f40f979bd00 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:05.300289 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-036a4c8f-2daa-457b-84ab-9f40f979bd00 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:05.300788 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-036a4c8f-2daa-457b-84ab-9f40f979bd00 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:05.304778 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-036a4c8f-2daa-457b-84ab-9f40f979bd00 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:05.305558 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-036a4c8f-2daa-457b-84ab-9f40f979bd00 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:05.306038 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-036a4c8f-2daa-457b-84ab-9f40f979bd00 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:05.306463 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-036a4c8f-2daa-457b-84ab-9f40f979bd00 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:05.551359 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-69a0c8de-82d6-43de-a276-feebec60b990 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc074aee7d427bb0336fd19d31ef9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c580418dbc24525b6631dcd0a5f7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:05.564159 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-69a0c8de-82d6-43de-a276-feebec60b990 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] 10.222.0.17 "GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33" status: 200 len: 1315 microversion: 2.1 time: 0.632140 Oct 18 11:41:05.576407 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 41/96] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:04 2022] GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33 => generated 1315 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:05.576819 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-e08ad190-b2b9-4ee6-b856-9cc85182779b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:05.577804 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-e08ad190-b2b9-4ee6-b856-9cc85182779b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:05.587125 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e08ad190-b2b9-4ee6-b856-9cc85182779b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:05.588469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e08ad190-b2b9-4ee6-b856-9cc85182779b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:05.590386 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e08ad190-b2b9-4ee6-b856-9cc85182779b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:05.590386 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e08ad190-b2b9-4ee6-b856-9cc85182779b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:05.591249 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e08ad190-b2b9-4ee6-b856-9cc85182779b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:05.591948 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e08ad190-b2b9-4ee6-b856-9cc85182779b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:05.807204 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-e08ad190-b2b9-4ee6-b856-9cc85182779b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:05.816396 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-e08ad190-b2b9-4ee6-b856-9cc85182779b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13" status: 200 len: 1366 microversion: 2.1 time: 0.249710 Oct 18 11:41:05.820440 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 42/97] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:05 2022] GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:05.896233 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-036a4c8f-2daa-457b-84ab-9f40f979bd00 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:05.931855 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-16063d3a-8479-4139-a6f7-d634d543b5aa req-83000b92-0e0f-4abe-9397-0f742ecd94bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96c06c00-7190-4ae9-a194-2d8f6123a781", "name": "network-vif-plugged", "status": "completed", "tag": "d593caa5-bbcf-4c0d-8fdd-619edf5a1057"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:41:05.953188 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-036a4c8f-2daa-457b-84ab-9f40f979bd00 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1361 microversion: 2.1 time: 0.669122 Oct 18 11:41:05.953188 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 56/98] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:05 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1361 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:05.953361 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-16063d3a-8479-4139-a6f7-d634d543b5aa req-83000b92-0e0f-4abe-9397-0f742ecd94bb service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:05.953361 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-16063d3a-8479-4139-a6f7-d634d543b5aa req-83000b92-0e0f-4abe-9397-0f742ecd94bb service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:05.953361 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-16063d3a-8479-4139-a6f7-d634d543b5aa req-83000b92-0e0f-4abe-9397-0f742ecd94bb service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:05.983188 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-16063d3a-8479-4139-a6f7-d634d543b5aa req-83000b92-0e0f-4abe-9397-0f742ecd94bb service nova] Creating event network-vif-plugged:d593caa5-bbcf-4c0d-8fdd-619edf5a1057 for instance 96c06c00-7190-4ae9-a194-2d8f6123a781 on hv-cinder-81558 Oct 18 11:41:05.998741 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-16063d3a-8479-4139-a6f7-d634d543b5aa req-83000b92-0e0f-4abe-9397-0f742ecd94bb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175436 Oct 18 11:41:06.005711 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 43/99] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:41:06.295721 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ff5f7bd4-b1cf-4d65-a8e5-ad9e135eec1a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:06.296323 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-ff5f7bd4-b1cf-4d65-a8e5-ad9e135eec1a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:06.306176 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ff5f7bd4-b1cf-4d65-a8e5-ad9e135eec1a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:06.306687 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ff5f7bd4-b1cf-4d65-a8e5-ad9e135eec1a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:06.307081 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ff5f7bd4-b1cf-4d65-a8e5-ad9e135eec1a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:06.308369 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ff5f7bd4-b1cf-4d65-a8e5-ad9e135eec1a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:06.309292 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ff5f7bd4-b1cf-4d65-a8e5-ad9e135eec1a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:06.310038 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ff5f7bd4-b1cf-4d65-a8e5-ad9e135eec1a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:06.484693 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-ff5f7bd4-b1cf-4d65-a8e5-ad9e135eec1a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:06.494038 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-ff5f7bd4-b1cf-4d65-a8e5-ad9e135eec1a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1321 microversion: 2.1 time: 0.203077 Oct 18 11:41:06.494800 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 57/100] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:06 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:06.590181 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-1ee181ff-6b0d-4d81-8742-bbeb5ed0b68d tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:06.591766 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-1ee181ff-6b0d-4d81-8742-bbeb5ed0b68d tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:06.607212 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1ee181ff-6b0d-4d81-8742-bbeb5ed0b68d tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:06.607711 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1ee181ff-6b0d-4d81-8742-bbeb5ed0b68d tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:06.610255 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1ee181ff-6b0d-4d81-8742-bbeb5ed0b68d tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:06.612023 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1ee181ff-6b0d-4d81-8742-bbeb5ed0b68d tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:06.614059 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1ee181ff-6b0d-4d81-8742-bbeb5ed0b68d tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:06.614761 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1ee181ff-6b0d-4d81-8742-bbeb5ed0b68d tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:06.846630 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-5f5d0a13-25ca-42c7-b90d-985f48ac7996 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:06.847978 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-5f5d0a13-25ca-42c7-b90d-985f48ac7996 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:06.864321 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5f5d0a13-25ca-42c7-b90d-985f48ac7996 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:06.865923 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5f5d0a13-25ca-42c7-b90d-985f48ac7996 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:06.866469 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5f5d0a13-25ca-42c7-b90d-985f48ac7996 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:06.872472 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5f5d0a13-25ca-42c7-b90d-985f48ac7996 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:06.873066 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5f5d0a13-25ca-42c7-b90d-985f48ac7996 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:06.873642 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5f5d0a13-25ca-42c7-b90d-985f48ac7996 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:07.318585 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-1ee181ff-6b0d-4d81-8742-bbeb5ed0b68d tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc074aee7d427bb0336fd19d31ef9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c580418dbc24525b6631dcd0a5f7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:07.327192 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-1ee181ff-6b0d-4d81-8742-bbeb5ed0b68d tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] 10.222.0.17 "GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33" status: 200 len: 1315 microversion: 2.1 time: 0.743337 Oct 18 11:41:07.327784 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 44/101] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:06 2022] GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33 => generated 1315 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:07.333080 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-807612e4-8ed9-483b-a863-72801e9f9425 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:07.333947 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-807612e4-8ed9-483b-a863-72801e9f9425 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:07.352230 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-807612e4-8ed9-483b-a863-72801e9f9425 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:07.352815 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-807612e4-8ed9-483b-a863-72801e9f9425 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:07.353282 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-807612e4-8ed9-483b-a863-72801e9f9425 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:07.357283 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-807612e4-8ed9-483b-a863-72801e9f9425 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:07.358982 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-807612e4-8ed9-483b-a863-72801e9f9425 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:07.360544 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-807612e4-8ed9-483b-a863-72801e9f9425 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:07.407359 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell0:SELECT=2 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:41:07.518836 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-5f5d0a13-25ca-42c7-b90d-985f48ac7996 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:07.544957 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-5f5d0a13-25ca-42c7-b90d-985f48ac7996 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13" status: 200 len: 1366 microversion: 2.1 time: 0.704243 Oct 18 11:41:07.545577 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 58/102] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:06 2022] GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13 => generated 1366 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:07.564172 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-64baa1d1-ecf7-4d7e-be29-e4d5132e1357 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:07.566903 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-64baa1d1-ecf7-4d7e-be29-e4d5132e1357 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:07.575275 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-807612e4-8ed9-483b-a863-72801e9f9425 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:07.585592 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-64baa1d1-ecf7-4d7e-be29-e4d5132e1357 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:07.586025 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-64baa1d1-ecf7-4d7e-be29-e4d5132e1357 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:07.586458 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-64baa1d1-ecf7-4d7e-be29-e4d5132e1357 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:07.587352 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-64baa1d1-ecf7-4d7e-be29-e4d5132e1357 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:07.587815 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-64baa1d1-ecf7-4d7e-be29-e4d5132e1357 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:07.588241 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-64baa1d1-ecf7-4d7e-be29-e4d5132e1357 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:07.597899 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-807612e4-8ed9-483b-a863-72801e9f9425 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1361 microversion: 2.1 time: 0.268873 Oct 18 11:41:07.607267 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 45/103] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:07 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1361 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:07.818993 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-64baa1d1-ecf7-4d7e-be29-e4d5132e1357 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:07.828180 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-64baa1d1-ecf7-4d7e-be29-e4d5132e1357 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1321 microversion: 2.1 time: 0.274507 Oct 18 11:41:07.829147 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 59/104] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:07 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:08.039509 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-9389e658-5d8e-4391-9503-8201c56537af req-1079c1c7-6df1-43bb-9bd5-d43dc1c53016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff0b9b95-b26f-4259-b929-a54954198f33", "name": "network-vif-plugged", "status": "completed", "tag": "b153888a-e54c-4f9b-96aa-a53dabfdf901"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:41:08.051400 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-9389e658-5d8e-4391-9503-8201c56537af req-1079c1c7-6df1-43bb-9bd5-d43dc1c53016 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:08.052045 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-9389e658-5d8e-4391-9503-8201c56537af req-1079c1c7-6df1-43bb-9bd5-d43dc1c53016 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:08.052697 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-9389e658-5d8e-4391-9503-8201c56537af req-1079c1c7-6df1-43bb-9bd5-d43dc1c53016 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:08.064903 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-9389e658-5d8e-4391-9503-8201c56537af req-1079c1c7-6df1-43bb-9bd5-d43dc1c53016 service nova] Creating event network-vif-plugged:b153888a-e54c-4f9b-96aa-a53dabfdf901 for instance ff0b9b95-b26f-4259-b929-a54954198f33 on hv-cinder-81558 Oct 18 11:41:08.070735 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-9389e658-5d8e-4391-9503-8201c56537af req-1079c1c7-6df1-43bb-9bd5-d43dc1c53016 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046974 Oct 18 11:41:08.071926 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 46/105] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:41:08.351733 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-37600ea2-679d-4efd-a2cd-38883c6682dc tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:08.352573 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-37600ea2-679d-4efd-a2cd-38883c6682dc tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:08.363356 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-37600ea2-679d-4efd-a2cd-38883c6682dc tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:08.364355 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-37600ea2-679d-4efd-a2cd-38883c6682dc tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:08.365722 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-37600ea2-679d-4efd-a2cd-38883c6682dc tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:08.367031 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-37600ea2-679d-4efd-a2cd-38883c6682dc tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:08.369333 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-37600ea2-679d-4efd-a2cd-38883c6682dc tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:08.370916 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-37600ea2-679d-4efd-a2cd-38883c6682dc tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:08.571017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-03cf1bf7-7dd5-4442-9c2e-c7fa1d2ea5f9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:08.571725 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-03cf1bf7-7dd5-4442-9c2e-c7fa1d2ea5f9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:08.575605 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell0:SELECT=2 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:41:08.587867 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-03cf1bf7-7dd5-4442-9c2e-c7fa1d2ea5f9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:08.591687 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-03cf1bf7-7dd5-4442-9c2e-c7fa1d2ea5f9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:08.593220 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-03cf1bf7-7dd5-4442-9c2e-c7fa1d2ea5f9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:08.596222 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-03cf1bf7-7dd5-4442-9c2e-c7fa1d2ea5f9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:08.597700 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-03cf1bf7-7dd5-4442-9c2e-c7fa1d2ea5f9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:08.598941 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-03cf1bf7-7dd5-4442-9c2e-c7fa1d2ea5f9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:08.926339 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-37600ea2-679d-4efd-a2cd-38883c6682dc tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc074aee7d427bb0336fd19d31ef9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c580418dbc24525b6631dcd0a5f7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:08.939232 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-37600ea2-679d-4efd-a2cd-38883c6682dc tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] 10.222.0.17 "GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33" status: 200 len: 1315 microversion: 2.1 time: 0.590552 Oct 18 11:41:08.940099 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 60/106] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:08 2022] GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33 => generated 1315 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:08.946667 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-03cf1bf7-7dd5-4442-9c2e-c7fa1d2ea5f9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:08.948266 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-a2747d51-e1c0-4445-b28f-0032c0e4eafa tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:08.949561 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-a2747d51-e1c0-4445-b28f-0032c0e4eafa tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:08.960562 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a2747d51-e1c0-4445-b28f-0032c0e4eafa tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:08.961954 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a2747d51-e1c0-4445-b28f-0032c0e4eafa tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:08.962705 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a2747d51-e1c0-4445-b28f-0032c0e4eafa tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:08.963636 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a2747d51-e1c0-4445-b28f-0032c0e4eafa tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:08.965315 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a2747d51-e1c0-4445-b28f-0032c0e4eafa tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:08.966136 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-03cf1bf7-7dd5-4442-9c2e-c7fa1d2ea5f9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13" status: 200 len: 1366 microversion: 2.1 time: 0.397894 Oct 18 11:41:08.966606 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a2747d51-e1c0-4445-b28f-0032c0e4eafa tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:08.972919 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 47/107] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:08 2022] GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13 => generated 1366 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:41:08.974681 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-d45d4d96-9e39-448d-bc17-46301374b0ec tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:08.975524 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-d45d4d96-9e39-448d-bc17-46301374b0ec tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:08.985304 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d45d4d96-9e39-448d-bc17-46301374b0ec tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:08.985830 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d45d4d96-9e39-448d-bc17-46301374b0ec tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:08.986269 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d45d4d96-9e39-448d-bc17-46301374b0ec tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:08.986980 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d45d4d96-9e39-448d-bc17-46301374b0ec tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:08.987550 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d45d4d96-9e39-448d-bc17-46301374b0ec tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:08.989345 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d45d4d96-9e39-448d-bc17-46301374b0ec tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:09.166804 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-a2747d51-e1c0-4445-b28f-0032c0e4eafa tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:09.176503 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-a2747d51-e1c0-4445-b28f-0032c0e4eafa tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1361 microversion: 2.1 time: 0.233551 Oct 18 11:41:09.177333 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 61/108] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:08 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1361 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:09.290715 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-d45d4d96-9e39-448d-bc17-46301374b0ec tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:09.304744 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-d45d4d96-9e39-448d-bc17-46301374b0ec tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1321 microversion: 2.1 time: 0.334677 Oct 18 11:41:09.306225 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 48/109] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:08 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1321 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:09.971861 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-bfd7c63f-8264-4840-8cee-49c267cccabd tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:09.973549 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-bfd7c63f-8264-4840-8cee-49c267cccabd tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:09.983271 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bfd7c63f-8264-4840-8cee-49c267cccabd tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:09.984377 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bfd7c63f-8264-4840-8cee-49c267cccabd tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:09.985063 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bfd7c63f-8264-4840-8cee-49c267cccabd tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:09.993678 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-5cb6d30e-4c32-49d6-81a5-9f87ab2a41c8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:09.994304 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-5cb6d30e-4c32-49d6-81a5-9f87ab2a41c8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:09.998970 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bfd7c63f-8264-4840-8cee-49c267cccabd tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:09.999887 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bfd7c63f-8264-4840-8cee-49c267cccabd tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:10.001260 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bfd7c63f-8264-4840-8cee-49c267cccabd tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:10.002860 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5cb6d30e-4c32-49d6-81a5-9f87ab2a41c8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:10.003348 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5cb6d30e-4c32-49d6-81a5-9f87ab2a41c8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:10.003783 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5cb6d30e-4c32-49d6-81a5-9f87ab2a41c8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:10.004481 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5cb6d30e-4c32-49d6-81a5-9f87ab2a41c8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:10.004962 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5cb6d30e-4c32-49d6-81a5-9f87ab2a41c8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:10.005386 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5cb6d30e-4c32-49d6-81a5-9f87ab2a41c8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:10.149730 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-5cb6d30e-4c32-49d6-81a5-9f87ab2a41c8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:10.158510 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-5cb6d30e-4c32-49d6-81a5-9f87ab2a41c8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13" status: 200 len: 1366 microversion: 2.1 time: 0.170279 Oct 18 11:41:10.161434 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 49/110] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:09 2022] GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:41:10.206011 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-bfd7c63f-8264-4840-8cee-49c267cccabd tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc074aee7d427bb0336fd19d31ef9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c580418dbc24525b6631dcd0a5f7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:10.208624 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-6af0fd07-c815-4af7-bdd7-2c00dcef5aae tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:10.209535 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-6af0fd07-c815-4af7-bdd7-2c00dcef5aae tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:10.217697 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6af0fd07-c815-4af7-bdd7-2c00dcef5aae tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:10.218682 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6af0fd07-c815-4af7-bdd7-2c00dcef5aae tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:10.219267 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6af0fd07-c815-4af7-bdd7-2c00dcef5aae tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:10.220122 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6af0fd07-c815-4af7-bdd7-2c00dcef5aae tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:10.220725 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6af0fd07-c815-4af7-bdd7-2c00dcef5aae tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:10.221356 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6af0fd07-c815-4af7-bdd7-2c00dcef5aae tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:10.224769 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-bfd7c63f-8264-4840-8cee-49c267cccabd tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] 10.222.0.17 "GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33" status: 200 len: 1315 microversion: 2.1 time: 0.262365 Oct 18 11:41:10.230975 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 62/111] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:09 2022] GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:10.335365 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-79ef0cd0-3ec7-46e2-bd01-ebf1dee96272 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:10.336434 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-79ef0cd0-3ec7-46e2-bd01-ebf1dee96272 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:10.367626 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-79ef0cd0-3ec7-46e2-bd01-ebf1dee96272 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:10.369830 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-79ef0cd0-3ec7-46e2-bd01-ebf1dee96272 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:10.370757 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-79ef0cd0-3ec7-46e2-bd01-ebf1dee96272 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:10.372140 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-79ef0cd0-3ec7-46e2-bd01-ebf1dee96272 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:10.373796 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-79ef0cd0-3ec7-46e2-bd01-ebf1dee96272 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:10.377813 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-79ef0cd0-3ec7-46e2-bd01-ebf1dee96272 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:10.462003 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-6af0fd07-c815-4af7-bdd7-2c00dcef5aae tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:10.471254 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-6af0fd07-c815-4af7-bdd7-2c00dcef5aae tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1547 microversion: 2.1 time: 0.266578 Oct 18 11:41:10.471835 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 50/112] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:10 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1547 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:41:10.501230 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-0d8b8017-64c9-44d9-b711-8f04693faa54 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:10.502065 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-0d8b8017-64c9-44d9-b711-8f04693faa54 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:10.508202 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0d8b8017-64c9-44d9-b711-8f04693faa54 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:10.508831 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0d8b8017-64c9-44d9-b711-8f04693faa54 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:10.509400 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0d8b8017-64c9-44d9-b711-8f04693faa54 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:10.510518 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0d8b8017-64c9-44d9-b711-8f04693faa54 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:10.511009 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0d8b8017-64c9-44d9-b711-8f04693faa54 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:10.511679 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0d8b8017-64c9-44d9-b711-8f04693faa54 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:10.658330 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-79ef0cd0-3ec7-46e2-bd01-ebf1dee96272 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:10.669660 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-79ef0cd0-3ec7-46e2-bd01-ebf1dee96272 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1321 microversion: 2.1 time: 0.342075 Oct 18 11:41:10.672889 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 63/113] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:10 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1321 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:10.794577 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-0d8b8017-64c9-44d9-b711-8f04693faa54 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.296582 Oct 18 11:41:10.795815 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 51/114] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Oct 18 11:41:10 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781/os-interface => generated 285 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:41:11.172768 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-ea08ec98-9f47-4e3e-abb3-d17a8737ed85 req-a080daa9-2ecf-425a-a569-d45d2d6708d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3ed125b-4ca6-484d-9da6-d6e46fba2a13", "name": "network-vif-plugged", "status": "completed", "tag": "d543b925-1dd1-417b-8252-8a6c6aa87525"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:41:11.188196 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-d5e48e0e-0cfe-4e13-b683-3413f1576d58 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:11.190721 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-d5e48e0e-0cfe-4e13-b683-3413f1576d58 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:11.192536 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-ea08ec98-9f47-4e3e-abb3-d17a8737ed85 req-a080daa9-2ecf-425a-a569-d45d2d6708d2 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:11.193044 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-ea08ec98-9f47-4e3e-abb3-d17a8737ed85 req-a080daa9-2ecf-425a-a569-d45d2d6708d2 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:11.193461 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-ea08ec98-9f47-4e3e-abb3-d17a8737ed85 req-a080daa9-2ecf-425a-a569-d45d2d6708d2 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:11.208203 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d5e48e0e-0cfe-4e13-b683-3413f1576d58 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:11.210543 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d5e48e0e-0cfe-4e13-b683-3413f1576d58 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:11.212708 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d5e48e0e-0cfe-4e13-b683-3413f1576d58 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:11.215316 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d5e48e0e-0cfe-4e13-b683-3413f1576d58 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:11.219048 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-ea08ec98-9f47-4e3e-abb3-d17a8737ed85 req-a080daa9-2ecf-425a-a569-d45d2d6708d2 service nova] Creating event network-vif-plugged:d543b925-1dd1-417b-8252-8a6c6aa87525 for instance b3ed125b-4ca6-484d-9da6-d6e46fba2a13 on hv-cinder-81558 Oct 18 11:41:11.219213 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d5e48e0e-0cfe-4e13-b683-3413f1576d58 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:11.219874 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d5e48e0e-0cfe-4e13-b683-3413f1576d58 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:11.227406 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-ea08ec98-9f47-4e3e-abb3-d17a8737ed85 req-a080daa9-2ecf-425a-a569-d45d2d6708d2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058114 Oct 18 11:41:11.238928 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 64/115] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:41:11.250922 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-30160389-c1fd-4653-9596-6bda96567387 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:11.252735 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-30160389-c1fd-4653-9596-6bda96567387 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:11.265656 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-30160389-c1fd-4653-9596-6bda96567387 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:11.266438 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-30160389-c1fd-4653-9596-6bda96567387 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:11.268285 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-30160389-c1fd-4653-9596-6bda96567387 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:11.269267 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-30160389-c1fd-4653-9596-6bda96567387 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:11.275644 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-30160389-c1fd-4653-9596-6bda96567387 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:11.276811 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-30160389-c1fd-4653-9596-6bda96567387 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:11.646998 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-30160389-c1fd-4653-9596-6bda96567387 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc074aee7d427bb0336fd19d31ef9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c580418dbc24525b6631dcd0a5f7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:11.674111 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-30160389-c1fd-4653-9596-6bda96567387 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] 10.222.0.17 "GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33" status: 200 len: 1502 microversion: 2.1 time: 0.427944 Oct 18 11:41:11.680880 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 65/116] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:11 2022] GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33 => generated 1502 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:41:11.725128 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-905d3e67-95f5-423e-a981-04b556f3eb18 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:11.726734 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-d5e48e0e-0cfe-4e13-b683-3413f1576d58 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:11.729340 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-905d3e67-95f5-423e-a981-04b556f3eb18 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:11.740250 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-d5e48e0e-0cfe-4e13-b683-3413f1576d58 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13" status: 200 len: 1366 microversion: 2.1 time: 0.557397 Oct 18 11:41:11.744321 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 52/117] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:11 2022] GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13 => generated 1366 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:11.755351 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-905d3e67-95f5-423e-a981-04b556f3eb18 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:11.756325 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-905d3e67-95f5-423e-a981-04b556f3eb18 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:11.758307 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-905d3e67-95f5-423e-a981-04b556f3eb18 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:11.759175 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-905d3e67-95f5-423e-a981-04b556f3eb18 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:11.760553 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-905d3e67-95f5-423e-a981-04b556f3eb18 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:11.764194 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-905d3e67-95f5-423e-a981-04b556f3eb18 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:11.952924 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-905d3e67-95f5-423e-a981-04b556f3eb18 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:11.963582 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-905d3e67-95f5-423e-a981-04b556f3eb18 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1321 microversion: 2.1 time: 0.271940 Oct 18 11:41:11.964581 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 66/118] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:11 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:41:12.688977 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-8791b612-6868-4278-b188-d9330c3e7caa req-8206d2f0-91b8-434f-9b40-698bd0721485 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96c06c00-7190-4ae9-a194-2d8f6123a781", "tag": "d593caa5-bbcf-4c0d-8fdd-619edf5a1057"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:41:12.698743 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-8791b612-6868-4278-b188-d9330c3e7caa req-8206d2f0-91b8-434f-9b40-698bd0721485 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:12.699214 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-8791b612-6868-4278-b188-d9330c3e7caa req-8206d2f0-91b8-434f-9b40-698bd0721485 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:12.699828 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-8791b612-6868-4278-b188-d9330c3e7caa req-8206d2f0-91b8-434f-9b40-698bd0721485 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:12.711530 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-8791b612-6868-4278-b188-d9330c3e7caa req-8206d2f0-91b8-434f-9b40-698bd0721485 service nova] Creating event network-changed:d593caa5-bbcf-4c0d-8fdd-619edf5a1057 for instance 96c06c00-7190-4ae9-a194-2d8f6123a781 on hv-cinder-81558 Oct 18 11:41:12.718574 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-8791b612-6868-4278-b188-d9330c3e7caa req-8206d2f0-91b8-434f-9b40-698bd0721485 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033091 Oct 18 11:41:12.719599 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 53/119] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:41:12.768741 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-c050eecb-da7c-43e8-933e-d5644c2d3867 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:12.770011 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-c050eecb-da7c-43e8-933e-d5644c2d3867 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:12.776754 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c050eecb-da7c-43e8-933e-d5644c2d3867 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:12.777473 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c050eecb-da7c-43e8-933e-d5644c2d3867 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:12.778078 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c050eecb-da7c-43e8-933e-d5644c2d3867 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:12.778916 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c050eecb-da7c-43e8-933e-d5644c2d3867 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:12.779642 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c050eecb-da7c-43e8-933e-d5644c2d3867 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:12.780199 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c050eecb-da7c-43e8-933e-d5644c2d3867 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:12.972694 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-c050eecb-da7c-43e8-933e-d5644c2d3867 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:12.985480 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-c050eecb-da7c-43e8-933e-d5644c2d3867 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13" status: 200 len: 1366 microversion: 2.1 time: 0.219878 Oct 18 11:41:12.986571 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 67/120] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:12 2022] GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:41:13.001034 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-8d8711f0-1b49-43e6-aee5-6f9be84bc0d4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:13.001034 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-8d8711f0-1b49-43e6-aee5-6f9be84bc0d4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:13.001034 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8d8711f0-1b49-43e6-aee5-6f9be84bc0d4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:13.001034 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8d8711f0-1b49-43e6-aee5-6f9be84bc0d4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:13.001463 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8d8711f0-1b49-43e6-aee5-6f9be84bc0d4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:13.002320 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8d8711f0-1b49-43e6-aee5-6f9be84bc0d4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:13.002932 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8d8711f0-1b49-43e6-aee5-6f9be84bc0d4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:13.003323 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8d8711f0-1b49-43e6-aee5-6f9be84bc0d4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:13.165656 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-8d8711f0-1b49-43e6-aee5-6f9be84bc0d4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:13.177748 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-8d8711f0-1b49-43e6-aee5-6f9be84bc0d4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1321 microversion: 2.1 time: 0.193559 Oct 18 11:41:13.182236 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 54/121] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:12 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:41:13.321367 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-4e839e83-2b69-45cc-b8e8-8eccc5c6a226 req-08ab1e5e-ed88-4278-8495-54a12a3fdff3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ede7abe-e470-4b36-83ed-cd28e0347ac8", "name": "network-vif-plugged", "status": "completed", "tag": "f8af432d-f3da-4a10-a4cd-7e455ecc405c"}, {"server_uuid": "774e4e5d-2e5c-40f1-943e-cb9bfd39738b", "name": "network-vif-plugged", "status": "completed", "tag": "79c25e94-9586-406b-90b5-8070148e296f"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:41:13.333484 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-4e839e83-2b69-45cc-b8e8-8eccc5c6a226 req-08ab1e5e-ed88-4278-8495-54a12a3fdff3 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:13.334199 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-4e839e83-2b69-45cc-b8e8-8eccc5c6a226 req-08ab1e5e-ed88-4278-8495-54a12a3fdff3 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:13.334731 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-4e839e83-2b69-45cc-b8e8-8eccc5c6a226 req-08ab1e5e-ed88-4278-8495-54a12a3fdff3 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:13.348440 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-4e839e83-2b69-45cc-b8e8-8eccc5c6a226 req-08ab1e5e-ed88-4278-8495-54a12a3fdff3 service nova] Creating event network-vif-plugged:f8af432d-f3da-4a10-a4cd-7e455ecc405c for instance 4ede7abe-e470-4b36-83ed-cd28e0347ac8 on hv-cinder-81558 Oct 18 11:41:13.349185 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-4e839e83-2b69-45cc-b8e8-8eccc5c6a226 req-08ab1e5e-ed88-4278-8495-54a12a3fdff3 service nova] Creating event network-vif-plugged:79c25e94-9586-406b-90b5-8070148e296f for instance 774e4e5d-2e5c-40f1-943e-cb9bfd39738b on hv-cinder-81558 Oct 18 11:41:13.355685 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-4e839e83-2b69-45cc-b8e8-8eccc5c6a226 req-08ab1e5e-ed88-4278-8495-54a12a3fdff3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038288 Oct 18 11:41:13.356290 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 68/122] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:41:14.009408 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-1c043c8e-f302-4022-8148-8a11fb4de772 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:14.010264 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-1c043c8e-f302-4022-8148-8a11fb4de772 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:14.017751 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1c043c8e-f302-4022-8148-8a11fb4de772 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:14.018543 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1c043c8e-f302-4022-8148-8a11fb4de772 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:14.018974 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1c043c8e-f302-4022-8148-8a11fb4de772 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:14.020085 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1c043c8e-f302-4022-8148-8a11fb4de772 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:14.020540 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1c043c8e-f302-4022-8148-8a11fb4de772 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:14.021310 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1c043c8e-f302-4022-8148-8a11fb4de772 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:14.169788 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-1c043c8e-f302-4022-8148-8a11fb4de772 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:14.178111 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-1c043c8e-f302-4022-8148-8a11fb4de772 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13" status: 200 len: 1366 microversion: 2.1 time: 0.172650 Oct 18 11:41:14.179263 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 55/123] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:14 2022] GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:14.206366 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-4b86947f-1115-41c5-94ed-444032b7eff4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:14.207058 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-4b86947f-1115-41c5-94ed-444032b7eff4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:14.220813 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4b86947f-1115-41c5-94ed-444032b7eff4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:14.221331 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4b86947f-1115-41c5-94ed-444032b7eff4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:14.221758 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4b86947f-1115-41c5-94ed-444032b7eff4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:14.222446 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4b86947f-1115-41c5-94ed-444032b7eff4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:14.222888 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4b86947f-1115-41c5-94ed-444032b7eff4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:14.223600 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4b86947f-1115-41c5-94ed-444032b7eff4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:14.361052 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-4b86947f-1115-41c5-94ed-444032b7eff4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:14.368706 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-4b86947f-1115-41c5-94ed-444032b7eff4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1321 microversion: 2.1 time: 0.166662 Oct 18 11:41:14.369330 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 69/124] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:14 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:15.205588 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-6abf3065-2aae-4518-bd6c-bf97c142f927 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:15.206324 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-6abf3065-2aae-4518-bd6c-bf97c142f927 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:15.212956 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6abf3065-2aae-4518-bd6c-bf97c142f927 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:15.213536 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6abf3065-2aae-4518-bd6c-bf97c142f927 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:15.214641 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6abf3065-2aae-4518-bd6c-bf97c142f927 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:15.215518 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6abf3065-2aae-4518-bd6c-bf97c142f927 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:15.216609 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6abf3065-2aae-4518-bd6c-bf97c142f927 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:15.217204 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6abf3065-2aae-4518-bd6c-bf97c142f927 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:15.222357 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell1:SELECT=100 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:41:15.350631 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-6abf3065-2aae-4518-bd6c-bf97c142f927 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:15.359609 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-6abf3065-2aae-4518-bd6c-bf97c142f927 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13" status: 200 len: 1366 microversion: 2.1 time: 0.158512 Oct 18 11:41:15.360265 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 56/125] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:15 2022] GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:15.391933 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-845063bb-c7d5-4b55-b7df-8435ce81acbe tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:15.392538 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-845063bb-c7d5-4b55-b7df-8435ce81acbe tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:15.398694 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-845063bb-c7d5-4b55-b7df-8435ce81acbe tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:15.399150 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-845063bb-c7d5-4b55-b7df-8435ce81acbe tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:15.399586 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-845063bb-c7d5-4b55-b7df-8435ce81acbe tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:15.400272 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-845063bb-c7d5-4b55-b7df-8435ce81acbe tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:15.400714 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-845063bb-c7d5-4b55-b7df-8435ce81acbe tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:15.401862 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-845063bb-c7d5-4b55-b7df-8435ce81acbe tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:15.539693 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-845063bb-c7d5-4b55-b7df-8435ce81acbe tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:15.547206 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-845063bb-c7d5-4b55-b7df-8435ce81acbe tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1321 microversion: 2.1 time: 0.159153 Oct 18 11:41:15.547766 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 70/126] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:15 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:16.384798 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-1d2fb673-a548-4bc4-a94d-945285916421 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:16.385515 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-1d2fb673-a548-4bc4-a94d-945285916421 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:16.391624 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1d2fb673-a548-4bc4-a94d-945285916421 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:16.392111 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1d2fb673-a548-4bc4-a94d-945285916421 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:16.392668 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1d2fb673-a548-4bc4-a94d-945285916421 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:16.393375 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1d2fb673-a548-4bc4-a94d-945285916421 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:16.393858 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1d2fb673-a548-4bc4-a94d-945285916421 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:16.394328 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1d2fb673-a548-4bc4-a94d-945285916421 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:16.474420 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ecded262-be7f-4bdc-8dad-7da6d5873e59 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0af011d0-deca-49a5-8eda-0000b8e7fadc"}} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:41:16.476799 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-ecded262-be7f-4bdc-8dad-7da6d5873e59 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:16.487943 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ecded262-be7f-4bdc-8dad-7da6d5873e59 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:16.490831 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ecded262-be7f-4bdc-8dad-7da6d5873e59 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:16.491302 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ecded262-be7f-4bdc-8dad-7da6d5873e59 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:16.492201 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ecded262-be7f-4bdc-8dad-7da6d5873e59 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:16.492666 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ecded262-be7f-4bdc-8dad-7da6d5873e59 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:16.493116 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ecded262-be7f-4bdc-8dad-7da6d5873e59 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:16.600556 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-1d2fb673-a548-4bc4-a94d-945285916421 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:16.609387 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-1d2fb673-a548-4bc4-a94d-945285916421 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13" status: 200 len: 1555 microversion: 2.1 time: 0.230950 Oct 18 11:41:16.610722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 57/127] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:16 2022] GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13 => generated 1555 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:16.618004 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-f4f062a6-ce81-49f8-b31d-1ef2cbd35602 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:16.618870 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-f4f062a6-ce81-49f8-b31d-1ef2cbd35602 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:16.626989 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f4f062a6-ce81-49f8-b31d-1ef2cbd35602 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:16.627847 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f4f062a6-ce81-49f8-b31d-1ef2cbd35602 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:16.628538 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f4f062a6-ce81-49f8-b31d-1ef2cbd35602 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:16.629606 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f4f062a6-ce81-49f8-b31d-1ef2cbd35602 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:16.630664 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f4f062a6-ce81-49f8-b31d-1ef2cbd35602 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:16.631285 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f4f062a6-ce81-49f8-b31d-1ef2cbd35602 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:16.817548 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-f4f062a6-ce81-49f8-b31d-1ef2cbd35602 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:16.826297 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-f4f062a6-ce81-49f8-b31d-1ef2cbd35602 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1321 microversion: 2.1 time: 0.214181 Oct 18 11:41:16.827041 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 58/128] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:16 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:16.832910 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-19f8eaf8-1fb8-457a-96fa-b3e7c2acf14a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:16.833861 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-19f8eaf8-1fb8-457a-96fa-b3e7c2acf14a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:16.842161 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-19f8eaf8-1fb8-457a-96fa-b3e7c2acf14a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:16.842734 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-19f8eaf8-1fb8-457a-96fa-b3e7c2acf14a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:16.843236 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-19f8eaf8-1fb8-457a-96fa-b3e7c2acf14a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:16.848381 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-19f8eaf8-1fb8-457a-96fa-b3e7c2acf14a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:16.849447 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-19f8eaf8-1fb8-457a-96fa-b3e7c2acf14a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:16.849901 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-19f8eaf8-1fb8-457a-96fa-b3e7c2acf14a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:16.946912 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-19f8eaf8-1fb8-457a-96fa-b3e7c2acf14a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.118644 Oct 18 11:41:16.947590 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 59/129] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Oct 18 11:41:16 2022] GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13/os-interface => generated 285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:41:17.848896 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-f94c3608-c609-40dc-8e5b-2b5aa01f4143 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:17.850935 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-f94c3608-c609-40dc-8e5b-2b5aa01f4143 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:17.860267 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f94c3608-c609-40dc-8e5b-2b5aa01f4143 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:17.860909 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f94c3608-c609-40dc-8e5b-2b5aa01f4143 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:17.862746 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f94c3608-c609-40dc-8e5b-2b5aa01f4143 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:17.863523 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f94c3608-c609-40dc-8e5b-2b5aa01f4143 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:17.864112 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f94c3608-c609-40dc-8e5b-2b5aa01f4143 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:17.864528 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f94c3608-c609-40dc-8e5b-2b5aa01f4143 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:18.128162 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-f94c3608-c609-40dc-8e5b-2b5aa01f4143 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:18.136438 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-f94c3608-c609-40dc-8e5b-2b5aa01f4143 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1321 microversion: 2.1 time: 0.291913 Oct 18 11:41:18.137251 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 60/130] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:17 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1321 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:41:18.449310 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-0e83d4d7-7f92-487a-95be-6e4647b0eba3 req-2ec40b26-6633-43f3-b80a-2c0021b79276 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3ed125b-4ca6-484d-9da6-d6e46fba2a13", "tag": "d543b925-1dd1-417b-8252-8a6c6aa87525"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:41:18.466741 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-0e83d4d7-7f92-487a-95be-6e4647b0eba3 req-2ec40b26-6633-43f3-b80a-2c0021b79276 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:18.467776 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-0e83d4d7-7f92-487a-95be-6e4647b0eba3 req-2ec40b26-6633-43f3-b80a-2c0021b79276 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:18.477647 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-0e83d4d7-7f92-487a-95be-6e4647b0eba3 req-2ec40b26-6633-43f3-b80a-2c0021b79276 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:18.478216 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:41:18.538263 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-0e83d4d7-7f92-487a-95be-6e4647b0eba3 req-2ec40b26-6633-43f3-b80a-2c0021b79276 service nova] Creating event network-changed:d543b925-1dd1-417b-8252-8a6c6aa87525 for instance b3ed125b-4ca6-484d-9da6-d6e46fba2a13 on hv-cinder-81558 Oct 18 11:41:18.546112 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-ecded262-be7f-4bdc-8dad-7da6d5873e59 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] 10.222.0.17 "POST /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.075364 Oct 18 11:41:18.548619 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 71/131] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Oct 18 11:41:16 2022] POST /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33/os-volume_attachments => generated 194 bytes in 2079 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:41:18.555696 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-0e83d4d7-7f92-487a-95be-6e4647b0eba3 req-2ec40b26-6633-43f3-b80a-2c0021b79276 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110047 Oct 18 11:41:18.556983 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 61/132] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:41:19.176068 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-819970a9-bdc5-4c0c-99bb-bedfeafbc825 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:19.177393 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-819970a9-bdc5-4c0c-99bb-bedfeafbc825 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:19.188497 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_api:SELECT=78 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:41:19.190903 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-819970a9-bdc5-4c0c-99bb-bedfeafbc825 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:19.191810 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-819970a9-bdc5-4c0c-99bb-bedfeafbc825 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:19.192607 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-819970a9-bdc5-4c0c-99bb-bedfeafbc825 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:19.193650 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-819970a9-bdc5-4c0c-99bb-bedfeafbc825 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:19.194452 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-819970a9-bdc5-4c0c-99bb-bedfeafbc825 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:19.195072 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-819970a9-bdc5-4c0c-99bb-bedfeafbc825 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:19.459423 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-819970a9-bdc5-4c0c-99bb-bedfeafbc825 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:19.469169 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-819970a9-bdc5-4c0c-99bb-bedfeafbc825 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1516 microversion: 2.1 time: 0.305016 Oct 18 11:41:19.469973 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 72/133] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:19 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1516 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:19.498399 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-69f65221-4937-45b8-8ec2-7d35a202024a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:41:19.501120 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-69f65221-4937-45b8-8ec2-7d35a202024a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:19.513206 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-69f65221-4937-45b8-8ec2-7d35a202024a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:19.514383 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-69f65221-4937-45b8-8ec2-7d35a202024a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:19.515705 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-69f65221-4937-45b8-8ec2-7d35a202024a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:19.517087 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-69f65221-4937-45b8-8ec2-7d35a202024a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:19.518926 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-69f65221-4937-45b8-8ec2-7d35a202024a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:19.520345 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-69f65221-4937-45b8-8ec2-7d35a202024a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:19.558155 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.objects.instance [None req-69f65221-4937-45b8-8ec2-7d35a202024a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lazy-loading 'flavor' on Instance uuid 4ede7abe-e470-4b36-83ed-cd28e0347ac8 {{(pid=125486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:41:19.852928 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-69f65221-4937-45b8-8ec2-7d35a202024a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "POST /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8/action" status: 200 len: 32 microversion: 2.1 time: 0.359915 Oct 18 11:41:19.853902 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 62/134] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Oct 18 11:41:19 2022] POST /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8/action => generated 32 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 11:41:19.863501 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-6b5a464c-a541-4180-8554-113b843acbb2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:19.864292 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-6b5a464c-a541-4180-8554-113b843acbb2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:19.883362 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6b5a464c-a541-4180-8554-113b843acbb2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:19.887352 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6b5a464c-a541-4180-8554-113b843acbb2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:19.888391 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6b5a464c-a541-4180-8554-113b843acbb2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:19.893987 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6b5a464c-a541-4180-8554-113b843acbb2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:19.895621 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6b5a464c-a541-4180-8554-113b843acbb2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:19.897110 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6b5a464c-a541-4180-8554-113b843acbb2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:20.243870 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-6b5a464c-a541-4180-8554-113b843acbb2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:20.265476 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-6b5a464c-a541-4180-8554-113b843acbb2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1522 microversion: 2.1 time: 0.396701 Oct 18 11:41:20.266516 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 73/135] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:19 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:21.291803 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-c32a1769-a231-4af1-9414-803147b60abb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:21.292717 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-c32a1769-a231-4af1-9414-803147b60abb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:21.304818 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c32a1769-a231-4af1-9414-803147b60abb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:21.305418 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c32a1769-a231-4af1-9414-803147b60abb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:21.305972 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c32a1769-a231-4af1-9414-803147b60abb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:21.306906 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c32a1769-a231-4af1-9414-803147b60abb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:21.308152 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c32a1769-a231-4af1-9414-803147b60abb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:21.308705 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c32a1769-a231-4af1-9414-803147b60abb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:21.558052 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-c32a1769-a231-4af1-9414-803147b60abb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:21.565838 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-c32a1769-a231-4af1-9414-803147b60abb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1522 microversion: 2.1 time: 0.279400 Oct 18 11:41:21.566700 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 63/136] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:21 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:22.595833 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-f93d64a9-06f2-4280-988f-5fcfeb29bbee tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:22.599116 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-f93d64a9-06f2-4280-988f-5fcfeb29bbee tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:22.614416 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f93d64a9-06f2-4280-988f-5fcfeb29bbee tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:22.616340 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f93d64a9-06f2-4280-988f-5fcfeb29bbee tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:22.617030 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f93d64a9-06f2-4280-988f-5fcfeb29bbee tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:22.626723 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f93d64a9-06f2-4280-988f-5fcfeb29bbee tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:22.628222 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f93d64a9-06f2-4280-988f-5fcfeb29bbee tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:22.628916 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f93d64a9-06f2-4280-988f-5fcfeb29bbee tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:22.784315 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-f93d64a9-06f2-4280-988f-5fcfeb29bbee tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:22.797548 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-f93d64a9-06f2-4280-988f-5fcfeb29bbee tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1522 microversion: 2.1 time: 0.208322 Oct 18 11:41:22.798957 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 74/137] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:22 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:23.828483 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-ab420272-f407-4b00-8b79-1c735101a0b1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:23.829808 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-ab420272-f407-4b00-8b79-1c735101a0b1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:23.837840 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ab420272-f407-4b00-8b79-1c735101a0b1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:23.839383 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ab420272-f407-4b00-8b79-1c735101a0b1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:23.840162 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ab420272-f407-4b00-8b79-1c735101a0b1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:23.841481 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ab420272-f407-4b00-8b79-1c735101a0b1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:23.842377 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ab420272-f407-4b00-8b79-1c735101a0b1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:23.843041 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ab420272-f407-4b00-8b79-1c735101a0b1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:24.068413 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-ab420272-f407-4b00-8b79-1c735101a0b1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:24.078602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-ab420272-f407-4b00-8b79-1c735101a0b1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1522 microversion: 2.1 time: 0.254107 Oct 18 11:41:24.079886 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 64/138] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:23 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:25.104364 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-e0a2a178-1942-4aa7-b7de-fbecbf344da7 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:25.105025 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-e0a2a178-1942-4aa7-b7de-fbecbf344da7 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:25.118216 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e0a2a178-1942-4aa7-b7de-fbecbf344da7 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:25.119558 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e0a2a178-1942-4aa7-b7de-fbecbf344da7 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:25.120113 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e0a2a178-1942-4aa7-b7de-fbecbf344da7 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:25.121085 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e0a2a178-1942-4aa7-b7de-fbecbf344da7 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:25.121592 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e0a2a178-1942-4aa7-b7de-fbecbf344da7 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:25.121970 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e0a2a178-1942-4aa7-b7de-fbecbf344da7 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:25.361791 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-e0a2a178-1942-4aa7-b7de-fbecbf344da7 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:25.373118 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-e0a2a178-1942-4aa7-b7de-fbecbf344da7 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1522 microversion: 2.1 time: 0.273307 Oct 18 11:41:25.374136 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 75/139] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:25 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:26.397798 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-e04215a9-5cc1-43ad-9e10-dff2729e7325 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:26.399184 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-e04215a9-5cc1-43ad-9e10-dff2729e7325 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:26.406664 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e04215a9-5cc1-43ad-9e10-dff2729e7325 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:26.407404 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e04215a9-5cc1-43ad-9e10-dff2729e7325 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:26.408036 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e04215a9-5cc1-43ad-9e10-dff2729e7325 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:26.409492 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e04215a9-5cc1-43ad-9e10-dff2729e7325 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:26.410105 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e04215a9-5cc1-43ad-9e10-dff2729e7325 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:26.410686 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e04215a9-5cc1-43ad-9e10-dff2729e7325 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:26.595649 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-e04215a9-5cc1-43ad-9e10-dff2729e7325 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:26.603724 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-e04215a9-5cc1-43ad-9e10-dff2729e7325 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1522 microversion: 2.1 time: 0.210718 Oct 18 11:41:26.604221 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 65/140] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:26 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:27.627816 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-194b98b6-0e7f-49f9-8705-dacf7488458b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:27.628433 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-194b98b6-0e7f-49f9-8705-dacf7488458b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:27.648640 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-194b98b6-0e7f-49f9-8705-dacf7488458b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:27.649390 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-194b98b6-0e7f-49f9-8705-dacf7488458b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:27.650022 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-194b98b6-0e7f-49f9-8705-dacf7488458b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:27.650873 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-194b98b6-0e7f-49f9-8705-dacf7488458b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:27.651365 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-194b98b6-0e7f-49f9-8705-dacf7488458b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:27.651789 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-194b98b6-0e7f-49f9-8705-dacf7488458b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:27.902406 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-194b98b6-0e7f-49f9-8705-dacf7488458b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:27.920556 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-194b98b6-0e7f-49f9-8705-dacf7488458b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1522 microversion: 2.1 time: 0.296322 Oct 18 11:41:27.932882 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 76/141] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:27 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:28.586030 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-eca8f448-2c6c-4f84-a874-bd6ff46c20a6 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:28.586603 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-eca8f448-2c6c-4f84-a874-bd6ff46c20a6 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:28.590629 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_api:SELECT=74 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:41:28.595745 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-eca8f448-2c6c-4f84-a874-bd6ff46c20a6 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:28.596421 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-eca8f448-2c6c-4f84-a874-bd6ff46c20a6 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:28.596951 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-eca8f448-2c6c-4f84-a874-bd6ff46c20a6 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:28.597894 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-eca8f448-2c6c-4f84-a874-bd6ff46c20a6 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:28.598680 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-eca8f448-2c6c-4f84-a874-bd6ff46c20a6 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:28.599102 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-eca8f448-2c6c-4f84-a874-bd6ff46c20a6 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:28.630190 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-eca8f448-2c6c-4f84-a874-bd6ff46c20a6 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] Going to try to terminate instance {{(pid=125486) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 11:41:28.734351 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-eca8f448-2c6c-4f84-a874-bd6ff46c20a6 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33" status: 204 len: 0 microversion: 2.1 time: 0.150344 Oct 18 11:41:28.737591 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 66/142] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Oct 18 11:41:28 2022] DELETE /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 11:41:28.748388 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-6e35fde2-58f6-4d8f-95d7-ca9e6e9af103 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:28.748998 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-6e35fde2-58f6-4d8f-95d7-ca9e6e9af103 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:28.759842 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6e35fde2-58f6-4d8f-95d7-ca9e6e9af103 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:28.760331 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6e35fde2-58f6-4d8f-95d7-ca9e6e9af103 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:28.760760 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6e35fde2-58f6-4d8f-95d7-ca9e6e9af103 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:28.761471 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6e35fde2-58f6-4d8f-95d7-ca9e6e9af103 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:28.761918 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6e35fde2-58f6-4d8f-95d7-ca9e6e9af103 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:28.762334 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6e35fde2-58f6-4d8f-95d7-ca9e6e9af103 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:28.937034 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-6e35fde2-58f6-4d8f-95d7-ca9e6e9af103 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc074aee7d427bb0336fd19d31ef9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c580418dbc24525b6631dcd0a5f7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:28.948613 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-630faecb-c5fd-4db1-96c3-b280d6132b45 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:28.949479 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-630faecb-c5fd-4db1-96c3-b280d6132b45 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:28.949599 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-6e35fde2-58f6-4d8f-95d7-ca9e6e9af103 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] 10.222.0.17 "GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33" status: 200 len: 1554 microversion: 2.1 time: 0.205894 Oct 18 11:41:28.950413 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 77/143] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:28 2022] GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33 => generated 1554 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:41:28.958044 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-630faecb-c5fd-4db1-96c3-b280d6132b45 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:28.958528 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-630faecb-c5fd-4db1-96c3-b280d6132b45 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:28.958951 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-630faecb-c5fd-4db1-96c3-b280d6132b45 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:28.959664 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-630faecb-c5fd-4db1-96c3-b280d6132b45 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:28.960105 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-630faecb-c5fd-4db1-96c3-b280d6132b45 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:28.960513 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-630faecb-c5fd-4db1-96c3-b280d6132b45 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:29.172663 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-630faecb-c5fd-4db1-96c3-b280d6132b45 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:29.185837 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-630faecb-c5fd-4db1-96c3-b280d6132b45 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1522 microversion: 2.1 time: 0.241426 Oct 18 11:41:29.186502 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 67/144] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:28 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:29.973402 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-09a14e1a-cf2b-44fc-b456-9add3095e2e5 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:29.974009 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-09a14e1a-cf2b-44fc-b456-9add3095e2e5 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:29.981000 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-09a14e1a-cf2b-44fc-b456-9add3095e2e5 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:29.981489 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-09a14e1a-cf2b-44fc-b456-9add3095e2e5 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:29.981919 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-09a14e1a-cf2b-44fc-b456-9add3095e2e5 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:29.982617 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-09a14e1a-cf2b-44fc-b456-9add3095e2e5 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:29.983063 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-09a14e1a-cf2b-44fc-b456-9add3095e2e5 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:29.983536 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-09a14e1a-cf2b-44fc-b456-9add3095e2e5 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:30.202951 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-09a14e1a-cf2b-44fc-b456-9add3095e2e5 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc074aee7d427bb0336fd19d31ef9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c580418dbc24525b6631dcd0a5f7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:30.211985 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-3320bf81-ade4-4657-a443-40831ac7b9c8 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:30.212582 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-3320bf81-ade4-4657-a443-40831ac7b9c8 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:30.236533 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-09a14e1a-cf2b-44fc-b456-9add3095e2e5 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] 10.222.0.17 "GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33" status: 200 len: 1554 microversion: 2.1 time: 0.266863 Oct 18 11:41:30.239524 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3320bf81-ade4-4657-a443-40831ac7b9c8 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:30.251344 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 78/145] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:29 2022] GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33 => generated 1554 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:30.251526 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3320bf81-ade4-4657-a443-40831ac7b9c8 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:30.251526 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3320bf81-ade4-4657-a443-40831ac7b9c8 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:30.251526 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3320bf81-ade4-4657-a443-40831ac7b9c8 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:30.251526 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3320bf81-ade4-4657-a443-40831ac7b9c8 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:30.251837 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3320bf81-ade4-4657-a443-40831ac7b9c8 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:30.413380 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-3320bf81-ade4-4657-a443-40831ac7b9c8 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:30.424764 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-3320bf81-ade4-4657-a443-40831ac7b9c8 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1522 microversion: 2.1 time: 0.216485 Oct 18 11:41:30.425562 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 68/146] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:30 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:31.268572 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-22bdd080-efde-44f7-8209-31ad7ee143d6 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:31.269978 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-22bdd080-efde-44f7-8209-31ad7ee143d6 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:31.279056 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-22bdd080-efde-44f7-8209-31ad7ee143d6 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:31.279721 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-22bdd080-efde-44f7-8209-31ad7ee143d6 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:31.280488 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-22bdd080-efde-44f7-8209-31ad7ee143d6 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:31.281575 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-22bdd080-efde-44f7-8209-31ad7ee143d6 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:31.282214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-22bdd080-efde-44f7-8209-31ad7ee143d6 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:31.282825 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-22bdd080-efde-44f7-8209-31ad7ee143d6 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:31.450232 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-7a7c068f-9cc0-46ad-8f2b-ff420dc478fe tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:31.450851 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-7a7c068f-9cc0-46ad-8f2b-ff420dc478fe tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:31.456854 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7a7c068f-9cc0-46ad-8f2b-ff420dc478fe tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:31.457362 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7a7c068f-9cc0-46ad-8f2b-ff420dc478fe tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:31.457796 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7a7c068f-9cc0-46ad-8f2b-ff420dc478fe tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:31.458637 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7a7c068f-9cc0-46ad-8f2b-ff420dc478fe tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:31.459092 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7a7c068f-9cc0-46ad-8f2b-ff420dc478fe tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:31.459542 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7a7c068f-9cc0-46ad-8f2b-ff420dc478fe tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:31.646214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-22bdd080-efde-44f7-8209-31ad7ee143d6 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc074aee7d427bb0336fd19d31ef9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c580418dbc24525b6631dcd0a5f7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:31.653226 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-7a7c068f-9cc0-46ad-8f2b-ff420dc478fe tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:31.656164 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-22bdd080-efde-44f7-8209-31ad7ee143d6 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] 10.222.0.17 "GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33" status: 200 len: 1554 microversion: 2.1 time: 0.392199 Oct 18 11:41:31.657072 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 79/147] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:31 2022] GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33 => generated 1554 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:41:31.672166 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-7a7c068f-9cc0-46ad-8f2b-ff420dc478fe tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1522 microversion: 2.1 time: 0.226506 Oct 18 11:41:31.685416 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 69/148] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:31 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:41:32.023600 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-a7dbb25b-415a-402a-bb7d-e50e31af1565 req-61fafac4-9f68-44fe-8d60-482b4c766193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff0b9b95-b26f-4259-b929-a54954198f33", "name": "network-vif-deleted", "tag": "b153888a-e54c-4f9b-96aa-a53dabfdf901"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:41:32.036274 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-a7dbb25b-415a-402a-bb7d-e50e31af1565 req-61fafac4-9f68-44fe-8d60-482b4c766193 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:32.036759 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-a7dbb25b-415a-402a-bb7d-e50e31af1565 req-61fafac4-9f68-44fe-8d60-482b4c766193 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:32.037215 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-a7dbb25b-415a-402a-bb7d-e50e31af1565 req-61fafac4-9f68-44fe-8d60-482b4c766193 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:32.051373 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-a7dbb25b-415a-402a-bb7d-e50e31af1565 req-61fafac4-9f68-44fe-8d60-482b4c766193 service nova] Creating event network-vif-deleted:b153888a-e54c-4f9b-96aa-a53dabfdf901 for instance ff0b9b95-b26f-4259-b929-a54954198f33 on hv-cinder-81558 Oct 18 11:41:32.058733 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-a7dbb25b-415a-402a-bb7d-e50e31af1565 req-61fafac4-9f68-44fe-8d60-482b4c766193 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039623 Oct 18 11:41:32.059274 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 80/149] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:41:32.240886 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-d81fcf08-2eb9-4633-a7d0-49414c98458c tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-746677422", "imageRef": "a4917b56-ebe0-409a-894a-469900c12b94", "flavorRef": "452", "networks": [{"uuid": "b6b3633c-9a87-4a96-bcb5-0fed8272fb2d"}]}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:41:32.309617 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.network.neutron [None req-d81fcf08-2eb9-4633-a7d0-49414c98458c tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] validate_networks() for [('b6b3633c-9a87-4a96-bcb5-0fed8272fb2d', None, None, None, None, None)] {{(pid=125486) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 11:41:32.682913 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-0aee97f0-caf3-4f47-a2dd-d093e131b0ac tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:32.683622 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-0aee97f0-caf3-4f47-a2dd-d093e131b0ac tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:32.699724 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0aee97f0-caf3-4f47-a2dd-d093e131b0ac tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:32.700422 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0aee97f0-caf3-4f47-a2dd-d093e131b0ac tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:32.700916 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0aee97f0-caf3-4f47-a2dd-d093e131b0ac tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:32.701650 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0aee97f0-caf3-4f47-a2dd-d093e131b0ac tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:32.702105 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0aee97f0-caf3-4f47-a2dd-d093e131b0ac tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:32.704144 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0aee97f0-caf3-4f47-a2dd-d093e131b0ac tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:32.780934 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0aee97f0-caf3-4f47-a2dd-d093e131b0ac tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:32.782784 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0aee97f0-caf3-4f47-a2dd-d093e131b0ac tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:32.783574 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0aee97f0-caf3-4f47-a2dd-d093e131b0ac tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:32.784605 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.objects.instance [None req-0aee97f0-caf3-4f47-a2dd-d093e131b0ac tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lazy-loading 'fault' on Instance uuid ff0b9b95-b26f-4259-b929-a54954198f33 {{(pid=125485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:41:32.867963 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-0aee97f0-caf3-4f47-a2dd-d093e131b0ac tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bc074aee7d427bb0336fd19d31ef9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c580418dbc24525b6631dcd0a5f7876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:32.880650 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-0aee97f0-caf3-4f47-a2dd-d093e131b0ac tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] 10.222.0.17 "GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33" status: 200 len: 1351 microversion: 2.1 time: 0.203488 Oct 18 11:41:32.881534 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 81/150] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:32 2022] GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33 => generated 1351 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:41:32.886864 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-964bd3d5-f3b7-4d32-bb18-3f5e87620357 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:32.887804 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-964bd3d5-f3b7-4d32-bb18-3f5e87620357 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:32.907442 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-964bd3d5-f3b7-4d32-bb18-3f5e87620357 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:32.909831 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-964bd3d5-f3b7-4d32-bb18-3f5e87620357 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:32.910823 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-964bd3d5-f3b7-4d32-bb18-3f5e87620357 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:32.912371 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-964bd3d5-f3b7-4d32-bb18-3f5e87620357 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:32.913815 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-964bd3d5-f3b7-4d32-bb18-3f5e87620357 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:32.914472 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-964bd3d5-f3b7-4d32-bb18-3f5e87620357 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:33.053169 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-d81fcf08-2eb9-4633-a7d0-49414c98458c tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Flavor limits 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 11:41:33.053679 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-d81fcf08-2eb9-4633-a7d0-49414c98458c tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Image limits 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 11:41:33.054255 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-d81fcf08-2eb9-4633-a7d0-49414c98458c tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Flavor pref 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 11:41:33.054866 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-d81fcf08-2eb9-4633-a7d0-49414c98458c tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Image pref 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 11:41:33.055462 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-d81fcf08-2eb9-4633-a7d0-49414c98458c tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 11:41:33.078680 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d81fcf08-2eb9-4633-a7d0-49414c98458c tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:33.079326 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d81fcf08-2eb9-4633-a7d0-49414c98458c tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:33.080347 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d81fcf08-2eb9-4633-a7d0-49414c98458c tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:33.081212 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d81fcf08-2eb9-4633-a7d0-49414c98458c tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:33.082029 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d81fcf08-2eb9-4633-a7d0-49414c98458c tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:33.082560 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d81fcf08-2eb9-4633-a7d0-49414c98458c tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:33.092433 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:41:33.109858 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-d81fcf08-2eb9-4633-a7d0-49414c98458c tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Getting quotas for project 047b4fe1eab744d9b871985c30e76b0d. Resources: {'cores', 'instances', 'ram'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:41:33.115122 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-964bd3d5-f3b7-4d32-bb18-3f5e87620357 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:33.123677 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-964bd3d5-f3b7-4d32-bb18-3f5e87620357 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1522 microversion: 2.1 time: 0.240769 Oct 18 11:41:33.125700 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-d81fcf08-2eb9-4633-a7d0-49414c98458c tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Getting quotas for user fcb7dccab5ec46348c87ad4889120109 and project 047b4fe1eab744d9b871985c30e76b0d. Resources: {'cores', 'instances', 'ram'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:41:33.140372 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 82/151] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:32 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:33.150198 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-d81fcf08-2eb9-4633-a7d0-49414c98458c tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Going to run 1 instances... {{(pid=125486) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 11:41:33.153325 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-d81fcf08-2eb9-4633-a7d0-49414c98458c tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: ce665d5a-e059-4547-a267-a9a86d89a9c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4917b56-ebe0-409a-894a-469900c12b94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 11:41:33.216667 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-d81fcf08-2eb9-4633-a7d0-49414c98458c tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.979898 Oct 18 11:41:33.217796 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 70/152] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Oct 18 11:41:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 11:41:33.233480 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-21d94d75-f83c-4df6-9868-0e4a63bda739 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:33.234328 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-21d94d75-f83c-4df6-9868-0e4a63bda739 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: ce665d5a-e059-4547-a267-a9a86d89a9c9] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:33.326132 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-21d94d75-f83c-4df6-9868-0e4a63bda739 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:33.334597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-21d94d75-f83c-4df6-9868-0e4a63bda739 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9" status: 200 len: 1213 microversion: 2.1 time: 0.108577 Oct 18 11:41:33.335833 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 83/153] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:33 2022] GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9 => generated 1213 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:33.907364 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-12343509-f1e2-4a6b-80f9-d548171f75a3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:33.908174 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-12343509-f1e2-4a6b-80f9-d548171f75a3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:33.914762 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-12343509-f1e2-4a6b-80f9-d548171f75a3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:33.915436 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-12343509-f1e2-4a6b-80f9-d548171f75a3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:33.916017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-12343509-f1e2-4a6b-80f9-d548171f75a3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:33.916809 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-12343509-f1e2-4a6b-80f9-d548171f75a3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:33.917379 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-12343509-f1e2-4a6b-80f9-d548171f75a3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:33.917898 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-12343509-f1e2-4a6b-80f9-d548171f75a3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:33.942403 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.wsgi [None req-12343509-f1e2-4a6b-80f9-d548171f75a3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] HTTP exception thrown: Instance ff0b9b95-b26f-4259-b929-a54954198f33 could not be found. Oct 18 11:41:33.948001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-12343509-f1e2-4a6b-80f9-d548171f75a3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Request method failure captured: Oct 18 11:41:33.948001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: request: GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33 HTTP/1.1 Oct 18 11:41:33.948001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept: application/json Oct 18 11:41:33.948001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept-Encoding: identity Oct 18 11:41:33.948001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Connection: close Oct 18 11:41:33.948001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Length: 0 Oct 18 11:41:33.948001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Type: application/json Oct 18 11:41:33.948001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Host: 10.222.0.17 Oct 18 11:41:33.948001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Openstack-System-Scope: None Oct 18 11:41:33.948001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: User-Agent: python-urllib3/1.26.12 Oct 18 11:41:33.948001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Auth-Token: gAAAAABjTpCvPgLLypNechf_m3rC-61Ofim_5V_ZptjUAK53hMVjm0AwpITWOca_t6PiTOiAo_cUGQT4fPQ_CgriegQk-nCJBkqE-cCJCub_tG9havusZniJRrEPWRSOhgh7ur8fd6NV_qlbBRn48yg5pj5NatV1hM0nnljLZPAk0L3Lo_1eYo0 Oct 18 11:41:33.948001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Id: None Oct 18 11:41:33.948001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Name: None Oct 18 11:41:33.948001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Identity-Status: Confirmed Oct 18 11:41:33.948001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Is-Admin-Project: True Oct 18 11:41:33.948001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Id: default Oct 18 11:41:33.948001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Name: Default Oct 18 11:41:33.948001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Id: 6c580418dbc24525b6631dcd0a5f7876 Oct 18 11:41:33.948001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Name: tempest-DeleteServersTestJSON-1113678036 Oct 18 11:41:33.948001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Role: reader,member Oct 18 11:41:33.948001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Roles: reader,member Oct 18 11:41:33.949469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c580418dbc24525b6631dcd0a5f7876"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c580418dbc24525b6631dcd0a5f7876"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c580418dbc24525b6631dcd0a5f7876"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c580418dbc24525b6631dcd0a5f7876"}]}] Oct 18 11:41:33.949469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant: tempest-DeleteServersTestJSON-1113678036 Oct 18 11:41:33.949469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Id: 6c580418dbc24525b6631dcd0a5f7876 Oct 18 11:41:33.949469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Name: tempest-DeleteServersTestJSON-1113678036 Oct 18 11:41:33.949469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User: tempest-DeleteServersTestJSON-1113678036-project Oct 18 11:41:33.949469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Id: default Oct 18 11:41:33.949469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Name: Default Oct 18 11:41:33.949469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Id: 47bc074aee7d427bb0336fd19d31ef9d Oct 18 11:41:33.949469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Name: tempest-DeleteServersTestJSON-1113678036-project Oct 18 11:41:33.949469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: method: > Oct 18 11:41:33.949469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: exception: Instance ff0b9b95-b26f-4259-b929-a54954198f33 could not be found. Oct 18 11:41:33.949469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: action_args: {'id': 'ff0b9b95-b26f-4259-b929-a54954198f33'} Oct 18 11:41:33.950243 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:41:33.950243 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:41:33.950243 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:41:33.950243 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:41:33.950243 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:41:33.950243 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:41:33.950243 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:41:33.950243 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:41:33.950243 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:41:33.950243 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:41:33.950243 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff0b9b95-b26f-4259-b929-a54954198f33 could not be found. Oct 18 11:41:33.950243 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:41:33.950243 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:41:33.950243 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:41:33.950243 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:41:33.950243 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:41:33.950243 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:41:33.950243 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:41:33.950243 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:41:33.950243 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:41:33.951402 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:41:33.951402 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 11:41:33.951402 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 11:41:33.951402 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:41:33.951402 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:41:33.951402 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:41:33.951402 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:41:33.951402 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff0b9b95-b26f-4259-b929-a54954198f33 could not be found. Oct 18 11:41:33.951402 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:41:33.951402 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:41:33.951402 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:41:33.951402 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:41:33.951402 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:41:33.951402 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:41:33.951402 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:41:33.951402 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:41:33.951402 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff0b9b95-b26f-4259-b929-a54954198f33 could not be found. Oct 18 11:41:33.951402 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:41:33.955861 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-12343509-f1e2-4a6b-80f9-d548171f75a3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Returning 404 to user: Instance ff0b9b95-b26f-4259-b929-a54954198f33 could not be found. {{(pid=125486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:41:33.956951 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-12343509-f1e2-4a6b-80f9-d548171f75a3 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] 10.222.0.17 "GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33" status: 404 len: 111 microversion: 2.1 time: 0.053584 Oct 18 11:41:33.957993 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 71/154] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:33 2022] GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 11:41:34.122125 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-9778c5c6-37a8-4a99-9e9c-03fd5587fa98 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:34.124831 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-9778c5c6-37a8-4a99-9e9c-03fd5587fa98 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:34.132943 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9778c5c6-37a8-4a99-9e9c-03fd5587fa98 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:34.133666 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9778c5c6-37a8-4a99-9e9c-03fd5587fa98 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:34.134797 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9778c5c6-37a8-4a99-9e9c-03fd5587fa98 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:34.136459 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9778c5c6-37a8-4a99-9e9c-03fd5587fa98 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:34.137122 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9778c5c6-37a8-4a99-9e9c-03fd5587fa98 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:34.137544 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9778c5c6-37a8-4a99-9e9c-03fd5587fa98 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:34.151369 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-a1640a81-dc14-4272-8245-0b247a71ed19 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:34.153133 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-a1640a81-dc14-4272-8245-0b247a71ed19 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:34.160459 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a1640a81-dc14-4272-8245-0b247a71ed19 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:34.161225 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a1640a81-dc14-4272-8245-0b247a71ed19 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:34.161872 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a1640a81-dc14-4272-8245-0b247a71ed19 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:34.162873 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a1640a81-dc14-4272-8245-0b247a71ed19 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:34.163490 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a1640a81-dc14-4272-8245-0b247a71ed19 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:34.164676 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a1640a81-dc14-4272-8245-0b247a71ed19 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:34.166083 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.wsgi [None req-9778c5c6-37a8-4a99-9e9c-03fd5587fa98 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] HTTP exception thrown: Instance ff0b9b95-b26f-4259-b929-a54954198f33 could not be found. Oct 18 11:41:34.182282 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-9778c5c6-37a8-4a99-9e9c-03fd5587fa98 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Request method failure captured: Oct 18 11:41:34.182282 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33/os-volume_attachments HTTP/1.1 Oct 18 11:41:34.182282 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:41:34.182282 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:41:34.182282 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:41:34.182282 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 0 Oct 18 11:41:34.182282 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:41:34.182282 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:41:34.182282 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:41:34.182282 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:41:34.182282 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpCvPgLLypNechf_m3rC-61Ofim_5V_ZptjUAK53hMVjm0AwpITWOca_t6PiTOiAo_cUGQT4fPQ_CgriegQk-nCJBkqE-cCJCub_tG9havusZniJRrEPWRSOhgh7ur8fd6NV_qlbBRn48yg5pj5NatV1hM0nnljLZPAk0L3Lo_1eYo0 Oct 18 11:41:34.182282 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:41:34.182282 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:41:34.182282 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:41:34.182282 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:41:34.182282 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:41:34.182282 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:41:34.182282 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: 6c580418dbc24525b6631dcd0a5f7876 Oct 18 11:41:34.182282 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-DeleteServersTestJSON-1113678036 Oct 18 11:41:34.182282 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:41:34.182282 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:41:34.183672 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c580418dbc24525b6631dcd0a5f7876"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c580418dbc24525b6631dcd0a5f7876"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c580418dbc24525b6631dcd0a5f7876"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c580418dbc24525b6631dcd0a5f7876"}]}] Oct 18 11:41:34.183672 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-DeleteServersTestJSON-1113678036 Oct 18 11:41:34.183672 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: 6c580418dbc24525b6631dcd0a5f7876 Oct 18 11:41:34.183672 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-DeleteServersTestJSON-1113678036 Oct 18 11:41:34.183672 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-DeleteServersTestJSON-1113678036-project Oct 18 11:41:34.183672 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:41:34.183672 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:41:34.183672 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: 47bc074aee7d427bb0336fd19d31ef9d Oct 18 11:41:34.183672 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-DeleteServersTestJSON-1113678036-project Oct 18 11:41:34.183672 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: > Oct 18 11:41:34.183672 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Instance ff0b9b95-b26f-4259-b929-a54954198f33 could not be found. Oct 18 11:41:34.183672 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'server_id': 'ff0b9b95-b26f-4259-b929-a54954198f33'} Oct 18 11:41:34.185449 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:41:34.185449 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:41:34.185449 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:41:34.185449 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:41:34.185449 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:41:34.185449 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:41:34.185449 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:41:34.185449 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:41:34.185449 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:41:34.185449 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:41:34.185449 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff0b9b95-b26f-4259-b929-a54954198f33 could not be found. Oct 18 11:41:34.185449 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:41:34.185449 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:41:34.185449 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:41:34.185449 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:41:34.185449 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:41:34.185449 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:41:34.185449 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:41:34.185449 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:41:34.185449 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:41:34.187055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:41:34.187055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 11:41:34.187055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 11:41:34.187055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 11:41:34.187055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 11:41:34.187055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 18 11:41:34.187055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 18 11:41:34.187055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:41:34.187055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:41:34.187055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff0b9b95-b26f-4259-b929-a54954198f33 could not be found. Oct 18 11:41:34.187055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:41:34.187055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:41:34.187055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:41:34.187055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:41:34.187055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:41:34.187055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:41:34.187055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:41:34.187055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:41:34.187055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff0b9b95-b26f-4259-b929-a54954198f33 could not be found. Oct 18 11:41:34.187055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:41:34.189269 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-9778c5c6-37a8-4a99-9e9c-03fd5587fa98 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Returning 404 to user: Instance ff0b9b95-b26f-4259-b929-a54954198f33 could not be found. {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:41:34.190811 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-9778c5c6-37a8-4a99-9e9c-03fd5587fa98 tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] 10.222.0.17 "GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.073467 Oct 18 11:41:34.198780 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 84/155] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Oct 18 11:41:34 2022] GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33/os-volume_attachments => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:41:34.369476 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-5dd3ad9d-e748-4909-b532-1303984e6cd5 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:34.370701 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-5dd3ad9d-e748-4909-b532-1303984e6cd5 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: ce665d5a-e059-4547-a267-a9a86d89a9c9] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:34.378430 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5dd3ad9d-e748-4909-b532-1303984e6cd5 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:34.379144 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5dd3ad9d-e748-4909-b532-1303984e6cd5 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:34.379715 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5dd3ad9d-e748-4909-b532-1303984e6cd5 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:34.380798 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5dd3ad9d-e748-4909-b532-1303984e6cd5 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:34.381431 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5dd3ad9d-e748-4909-b532-1303984e6cd5 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:34.382005 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5dd3ad9d-e748-4909-b532-1303984e6cd5 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:34.408793 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-a1640a81-dc14-4272-8245-0b247a71ed19 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:34.422377 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-a1640a81-dc14-4272-8245-0b247a71ed19 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1522 microversion: 2.1 time: 0.277405 Oct 18 11:41:34.424416 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 72/156] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:34 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:34.483334 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-5dd3ad9d-e748-4909-b532-1303984e6cd5 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:34.492961 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-5dd3ad9d-e748-4909-b532-1303984e6cd5 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9" status: 200 len: 1265 microversion: 2.1 time: 0.128521 Oct 18 11:41:34.494321 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 85/157] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:34 2022] GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9 => generated 1265 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:35.449808 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-53d25c4c-ecd5-4f30-a501-bccdc1a20daf tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:35.451277 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-53d25c4c-ecd5-4f30-a501-bccdc1a20daf tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:35.460108 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-53d25c4c-ecd5-4f30-a501-bccdc1a20daf tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:35.461565 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-53d25c4c-ecd5-4f30-a501-bccdc1a20daf tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:35.464519 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-53d25c4c-ecd5-4f30-a501-bccdc1a20daf tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:35.466027 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-53d25c4c-ecd5-4f30-a501-bccdc1a20daf tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:35.466677 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-53d25c4c-ecd5-4f30-a501-bccdc1a20daf tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:35.467578 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-53d25c4c-ecd5-4f30-a501-bccdc1a20daf tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:35.521939 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-f2984bba-79d7-4b55-bf31-8dbf5ae4eb56 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:35.523127 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-f2984bba-79d7-4b55-bf31-8dbf5ae4eb56 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: ce665d5a-e059-4547-a267-a9a86d89a9c9] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:35.532147 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f2984bba-79d7-4b55-bf31-8dbf5ae4eb56 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:35.532951 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f2984bba-79d7-4b55-bf31-8dbf5ae4eb56 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:35.533715 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f2984bba-79d7-4b55-bf31-8dbf5ae4eb56 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:35.534846 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f2984bba-79d7-4b55-bf31-8dbf5ae4eb56 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:35.535534 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f2984bba-79d7-4b55-bf31-8dbf5ae4eb56 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:35.536110 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f2984bba-79d7-4b55-bf31-8dbf5ae4eb56 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:35.667557 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-53d25c4c-ecd5-4f30-a501-bccdc1a20daf tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:35.676759 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-53d25c4c-ecd5-4f30-a501-bccdc1a20daf tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1522 microversion: 2.1 time: 0.231759 Oct 18 11:41:35.680896 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 73/158] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:35 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:35.683141 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-fd2bac84-0f24-447e-a671-f835996297ef tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:35.683724 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-fd2bac84-0f24-447e-a671-f835996297ef tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:35.691164 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fd2bac84-0f24-447e-a671-f835996297ef tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:35.691871 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fd2bac84-0f24-447e-a671-f835996297ef tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:35.692612 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fd2bac84-0f24-447e-a671-f835996297ef tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:35.693636 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fd2bac84-0f24-447e-a671-f835996297ef tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:35.694263 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fd2bac84-0f24-447e-a671-f835996297ef tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:35.694706 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fd2bac84-0f24-447e-a671-f835996297ef tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:35.719373 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.wsgi [None req-fd2bac84-0f24-447e-a671-f835996297ef tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] HTTP exception thrown: Instance ff0b9b95-b26f-4259-b929-a54954198f33 could not be found. Oct 18 11:41:35.722502 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-fd2bac84-0f24-447e-a671-f835996297ef tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Request method failure captured: Oct 18 11:41:35.722502 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: request: DELETE /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33 HTTP/1.1 Oct 18 11:41:35.722502 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept: application/json Oct 18 11:41:35.722502 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept-Encoding: identity Oct 18 11:41:35.722502 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Connection: close Oct 18 11:41:35.722502 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Length: 0 Oct 18 11:41:35.722502 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Type: application/json Oct 18 11:41:35.722502 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Host: 10.222.0.17 Oct 18 11:41:35.722502 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Openstack-System-Scope: None Oct 18 11:41:35.722502 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: User-Agent: python-urllib3/1.26.12 Oct 18 11:41:35.722502 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Auth-Token: gAAAAABjTpCvPgLLypNechf_m3rC-61Ofim_5V_ZptjUAK53hMVjm0AwpITWOca_t6PiTOiAo_cUGQT4fPQ_CgriegQk-nCJBkqE-cCJCub_tG9havusZniJRrEPWRSOhgh7ur8fd6NV_qlbBRn48yg5pj5NatV1hM0nnljLZPAk0L3Lo_1eYo0 Oct 18 11:41:35.722502 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Id: None Oct 18 11:41:35.722502 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Name: None Oct 18 11:41:35.722502 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Identity-Status: Confirmed Oct 18 11:41:35.722502 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Is-Admin-Project: True Oct 18 11:41:35.722502 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Id: default Oct 18 11:41:35.722502 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Name: Default Oct 18 11:41:35.722502 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Id: 6c580418dbc24525b6631dcd0a5f7876 Oct 18 11:41:35.722502 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Name: tempest-DeleteServersTestJSON-1113678036 Oct 18 11:41:35.722502 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Role: reader,member Oct 18 11:41:35.722502 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Roles: reader,member Oct 18 11:41:35.724194 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c580418dbc24525b6631dcd0a5f7876"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c580418dbc24525b6631dcd0a5f7876"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c580418dbc24525b6631dcd0a5f7876"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c580418dbc24525b6631dcd0a5f7876"}]}] Oct 18 11:41:35.724194 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant: tempest-DeleteServersTestJSON-1113678036 Oct 18 11:41:35.724194 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Id: 6c580418dbc24525b6631dcd0a5f7876 Oct 18 11:41:35.724194 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Name: tempest-DeleteServersTestJSON-1113678036 Oct 18 11:41:35.724194 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User: tempest-DeleteServersTestJSON-1113678036-project Oct 18 11:41:35.724194 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Id: default Oct 18 11:41:35.724194 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Name: Default Oct 18 11:41:35.724194 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Id: 47bc074aee7d427bb0336fd19d31ef9d Oct 18 11:41:35.724194 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Name: tempest-DeleteServersTestJSON-1113678036-project Oct 18 11:41:35.724194 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: method: > Oct 18 11:41:35.724194 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: exception: Instance ff0b9b95-b26f-4259-b929-a54954198f33 could not be found. Oct 18 11:41:35.724194 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: action_args: {'id': 'ff0b9b95-b26f-4259-b929-a54954198f33'} Oct 18 11:41:35.725122 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:41:35.725122 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:41:35.725122 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:41:35.725122 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:41:35.725122 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:41:35.725122 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:41:35.725122 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:41:35.725122 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:41:35.725122 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:41:35.725122 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:41:35.725122 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff0b9b95-b26f-4259-b929-a54954198f33 could not be found. Oct 18 11:41:35.725122 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:41:35.725122 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:41:35.725122 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:41:35.725122 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:41:35.725122 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:41:35.725122 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:41:35.725122 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:41:35.725122 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:41:35.725122 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:41:35.726312 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:41:35.726312 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 11:41:35.726312 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 11:41:35.726312 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 11:41:35.726312 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 11:41:35.726312 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:41:35.726312 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:41:35.726312 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:41:35.726312 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:41:35.726312 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff0b9b95-b26f-4259-b929-a54954198f33 could not be found. Oct 18 11:41:35.726312 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:41:35.726312 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:41:35.726312 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:41:35.726312 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:41:35.726312 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:41:35.726312 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:41:35.726312 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:41:35.726312 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:41:35.726312 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff0b9b95-b26f-4259-b929-a54954198f33 could not be found. Oct 18 11:41:35.726312 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:41:35.728868 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-fd2bac84-0f24-447e-a671-f835996297ef tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Returning 404 to user: Instance ff0b9b95-b26f-4259-b929-a54954198f33 could not be found. {{(pid=125486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:41:35.729987 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-fd2bac84-0f24-447e-a671-f835996297ef tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33" status: 404 len: 111 microversion: 2.1 time: 0.051129 Oct 18 11:41:35.730822 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 74/159] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Oct 18 11:41:35 2022] DELETE /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:41:35.743005 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-b5cd375d-229f-408b-a334-558292ec243e tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:35.744545 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-b5cd375d-229f-408b-a334-558292ec243e tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] [instance: ff0b9b95-b26f-4259-b929-a54954198f33] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:35.755285 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b5cd375d-229f-408b-a334-558292ec243e tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:35.756003 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b5cd375d-229f-408b-a334-558292ec243e tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:35.756618 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b5cd375d-229f-408b-a334-558292ec243e tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:35.757513 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b5cd375d-229f-408b-a334-558292ec243e tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:35.757993 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b5cd375d-229f-408b-a334-558292ec243e tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:35.758389 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b5cd375d-229f-408b-a334-558292ec243e tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:35.785894 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.wsgi [None req-b5cd375d-229f-408b-a334-558292ec243e tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] HTTP exception thrown: Instance ff0b9b95-b26f-4259-b929-a54954198f33 could not be found. Oct 18 11:41:35.785894 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-b5cd375d-229f-408b-a334-558292ec243e tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Request method failure captured: Oct 18 11:41:35.785894 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: request: GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33 HTTP/1.1 Oct 18 11:41:35.785894 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept: application/json Oct 18 11:41:35.785894 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept-Encoding: identity Oct 18 11:41:35.785894 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Connection: close Oct 18 11:41:35.785894 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Length: 0 Oct 18 11:41:35.785894 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Type: application/json Oct 18 11:41:35.785894 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Host: 10.222.0.17 Oct 18 11:41:35.785894 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Openstack-System-Scope: None Oct 18 11:41:35.785894 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: User-Agent: python-urllib3/1.26.12 Oct 18 11:41:35.785894 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Auth-Token: gAAAAABjTpCvPgLLypNechf_m3rC-61Ofim_5V_ZptjUAK53hMVjm0AwpITWOca_t6PiTOiAo_cUGQT4fPQ_CgriegQk-nCJBkqE-cCJCub_tG9havusZniJRrEPWRSOhgh7ur8fd6NV_qlbBRn48yg5pj5NatV1hM0nnljLZPAk0L3Lo_1eYo0 Oct 18 11:41:35.785894 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Id: None Oct 18 11:41:35.785894 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Name: None Oct 18 11:41:35.785894 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Identity-Status: Confirmed Oct 18 11:41:35.785894 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Is-Admin-Project: True Oct 18 11:41:35.785894 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Id: default Oct 18 11:41:35.785894 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Name: Default Oct 18 11:41:35.785894 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Id: 6c580418dbc24525b6631dcd0a5f7876 Oct 18 11:41:35.785894 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Name: tempest-DeleteServersTestJSON-1113678036 Oct 18 11:41:35.785894 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Role: reader,member Oct 18 11:41:35.785894 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Roles: reader,member Oct 18 11:41:35.787059 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c580418dbc24525b6631dcd0a5f7876"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6c580418dbc24525b6631dcd0a5f7876"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6c580418dbc24525b6631dcd0a5f7876"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6c580418dbc24525b6631dcd0a5f7876"}]}] Oct 18 11:41:35.787059 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant: tempest-DeleteServersTestJSON-1113678036 Oct 18 11:41:35.787059 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Id: 6c580418dbc24525b6631dcd0a5f7876 Oct 18 11:41:35.787059 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Name: tempest-DeleteServersTestJSON-1113678036 Oct 18 11:41:35.787059 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User: tempest-DeleteServersTestJSON-1113678036-project Oct 18 11:41:35.787059 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Id: default Oct 18 11:41:35.787059 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Name: Default Oct 18 11:41:35.787059 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Id: 47bc074aee7d427bb0336fd19d31ef9d Oct 18 11:41:35.787059 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Name: tempest-DeleteServersTestJSON-1113678036-project Oct 18 11:41:35.787059 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: method: > Oct 18 11:41:35.787059 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: exception: Instance ff0b9b95-b26f-4259-b929-a54954198f33 could not be found. Oct 18 11:41:35.787059 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: action_args: {'id': 'ff0b9b95-b26f-4259-b929-a54954198f33'} Oct 18 11:41:35.791801 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:41:35.791801 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:41:35.791801 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:41:35.791801 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:41:35.791801 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:41:35.791801 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:41:35.791801 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:41:35.791801 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:41:35.791801 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:41:35.791801 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:41:35.791801 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff0b9b95-b26f-4259-b929-a54954198f33 could not be found. Oct 18 11:41:35.791801 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:41:35.791801 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:41:35.791801 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:41:35.791801 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:41:35.791801 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:41:35.791801 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:41:35.791801 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:41:35.791801 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:41:35.791801 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:41:35.792817 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:41:35.792817 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 11:41:35.792817 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 11:41:35.792817 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:41:35.792817 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:41:35.792817 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:41:35.792817 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:41:35.792817 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff0b9b95-b26f-4259-b929-a54954198f33 could not be found. Oct 18 11:41:35.792817 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:41:35.792817 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:41:35.792817 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:41:35.792817 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:41:35.792817 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:41:35.792817 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:41:35.792817 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:41:35.792817 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:41:35.792817 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff0b9b95-b26f-4259-b929-a54954198f33 could not be found. Oct 18 11:41:35.792817 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:41:35.794245 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-b5cd375d-229f-408b-a334-558292ec243e tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] Returning 404 to user: Instance ff0b9b95-b26f-4259-b929-a54954198f33 could not be found. {{(pid=125486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:41:35.794245 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-b5cd375d-229f-408b-a334-558292ec243e tempest-DeleteServersTestJSON-1113678036 tempest-DeleteServersTestJSON-1113678036-project] 10.222.0.17 "GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33" status: 404 len: 111 microversion: 2.1 time: 0.050502 Oct 18 11:41:35.794245 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 75/160] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:35 2022] GET /compute/v2.1/servers/ff0b9b95-b26f-4259-b929-a54954198f33 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:41:35.840245 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-f2984bba-79d7-4b55-bf31-8dbf5ae4eb56 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:35.854894 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-f2984bba-79d7-4b55-bf31-8dbf5ae4eb56 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9" status: 200 len: 1313 microversion: 2.1 time: 0.337648 Oct 18 11:41:35.855779 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 86/161] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:35 2022] GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9 => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:36.574945 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-67063606-adf2-46de-bc8b-017607cf6f02 req-904cc286-9040-4bae-b26a-9bf8da17345b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce665d5a-e059-4547-a267-a9a86d89a9c9", "tag": "1cb87854-891f-4219-898c-41598a9f4885"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:41:36.605891 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-67063606-adf2-46de-bc8b-017607cf6f02 req-904cc286-9040-4bae-b26a-9bf8da17345b service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:36.606478 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-67063606-adf2-46de-bc8b-017607cf6f02 req-904cc286-9040-4bae-b26a-9bf8da17345b service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:36.607310 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-67063606-adf2-46de-bc8b-017607cf6f02 req-904cc286-9040-4bae-b26a-9bf8da17345b service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:36.635070 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-67063606-adf2-46de-bc8b-017607cf6f02 req-904cc286-9040-4bae-b26a-9bf8da17345b service nova] Creating event network-changed:1cb87854-891f-4219-898c-41598a9f4885 for instance ce665d5a-e059-4547-a267-a9a86d89a9c9 on hv-cinder-81558 Oct 18 11:41:36.640777 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-67063606-adf2-46de-bc8b-017607cf6f02 req-904cc286-9040-4bae-b26a-9bf8da17345b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080148 Oct 18 11:41:36.642250 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 76/162] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:41:36.702062 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-757474e2-288c-46bf-9cc9-fbbcf733a619 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:36.703316 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-757474e2-288c-46bf-9cc9-fbbcf733a619 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:36.713035 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-757474e2-288c-46bf-9cc9-fbbcf733a619 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:36.713811 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-757474e2-288c-46bf-9cc9-fbbcf733a619 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:36.714407 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-757474e2-288c-46bf-9cc9-fbbcf733a619 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:36.715562 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-757474e2-288c-46bf-9cc9-fbbcf733a619 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:36.716249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-757474e2-288c-46bf-9cc9-fbbcf733a619 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:36.716976 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-757474e2-288c-46bf-9cc9-fbbcf733a619 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:36.885404 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-0f51c376-0351-4be9-bc88-dc4dc1071a1f tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:36.886434 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-0f51c376-0351-4be9-bc88-dc4dc1071a1f tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: ce665d5a-e059-4547-a267-a9a86d89a9c9] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:36.895486 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0f51c376-0351-4be9-bc88-dc4dc1071a1f tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:36.897128 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0f51c376-0351-4be9-bc88-dc4dc1071a1f tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:36.897927 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0f51c376-0351-4be9-bc88-dc4dc1071a1f tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:36.899817 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0f51c376-0351-4be9-bc88-dc4dc1071a1f tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:36.900396 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0f51c376-0351-4be9-bc88-dc4dc1071a1f tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:36.901170 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0f51c376-0351-4be9-bc88-dc4dc1071a1f tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:36.940678 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-757474e2-288c-46bf-9cc9-fbbcf733a619 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:36.949455 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-757474e2-288c-46bf-9cc9-fbbcf733a619 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1522 microversion: 2.1 time: 0.251311 Oct 18 11:41:36.952059 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 87/163] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:36 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:37.203479 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-0f51c376-0351-4be9-bc88-dc4dc1071a1f tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:37.211399 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-0f51c376-0351-4be9-bc88-dc4dc1071a1f tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9" status: 200 len: 1313 microversion: 2.1 time: 0.335818 Oct 18 11:41:37.211985 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 77/164] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:36 2022] GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9 => generated 1313 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:41:37.580546 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-2e74930b-769d-433b-8584-c22fed031808 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-85533496", "imageRef": "a4917b56-ebe0-409a-894a-469900c12b94", "flavorRef": "452"}} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:41:37.643256 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.network.neutron [None req-2e74930b-769d-433b-8584-c22fed031808 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] validate_networks() for None {{(pid=125485) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 11:41:37.971631 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-2e74930b-769d-433b-8584-c22fed031808 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Flavor limits 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 11:41:37.972716 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-2e74930b-769d-433b-8584-c22fed031808 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Image limits 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 11:41:37.973843 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-2e74930b-769d-433b-8584-c22fed031808 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Flavor pref 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 11:41:37.974403 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-2e74930b-769d-433b-8584-c22fed031808 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Image pref 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 11:41:37.974785 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-7c7070a3-d93a-4ad5-aeb5-9d4b002eb798 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:37.975396 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-7c7070a3-d93a-4ad5-aeb5-9d4b002eb798 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:37.975855 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-2e74930b-769d-433b-8584-c22fed031808 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 11:41:37.982881 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7c7070a3-d93a-4ad5-aeb5-9d4b002eb798 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:37.983602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7c7070a3-d93a-4ad5-aeb5-9d4b002eb798 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:37.984356 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7c7070a3-d93a-4ad5-aeb5-9d4b002eb798 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:37.985289 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7c7070a3-d93a-4ad5-aeb5-9d4b002eb798 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:37.986237 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7c7070a3-d93a-4ad5-aeb5-9d4b002eb798 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:37.986816 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7c7070a3-d93a-4ad5-aeb5-9d4b002eb798 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:37.990628 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2e74930b-769d-433b-8584-c22fed031808 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:37.991114 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2e74930b-769d-433b-8584-c22fed031808 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:37.991543 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2e74930b-769d-433b-8584-c22fed031808 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:37.992257 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2e74930b-769d-433b-8584-c22fed031808 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:37.994194 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2e74930b-769d-433b-8584-c22fed031808 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:37.994847 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2e74930b-769d-433b-8584-c22fed031808 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:38.032346 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.quota [None req-2e74930b-769d-433b-8584-c22fed031808 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Getting quotas for project 4fb846ed3b9141c694927b06b387b433. Resources: {'cores', 'instances', 'ram'} {{(pid=125485) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:41:38.039783 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.quota [None req-2e74930b-769d-433b-8584-c22fed031808 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Getting quotas for user f286fcc4b509485dbb958873a2207592 and project 4fb846ed3b9141c694927b06b387b433. Resources: {'cores', 'instances', 'ram'} {{(pid=125485) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:41:38.055007 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-2e74930b-769d-433b-8584-c22fed031808 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Going to run 1 instances... {{(pid=125485) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 11:41:38.057928 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-2e74930b-769d-433b-8584-c22fed031808 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] [instance: 0f243ecd-6943-4fe7-ab6d-5278787504e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4917b56-ebe0-409a-894a-469900c12b94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125485) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 11:41:38.135232 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-2e74930b-769d-433b-8584-c22fed031808 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.558614 Oct 18 11:41:38.147858 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 88/165] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Oct 18 11:41:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 11:41:38.190171 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-3b73c593-1c46-4711-b2e2-5555d83c370a tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:38.191404 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-3b73c593-1c46-4711-b2e2-5555d83c370a tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] [instance: 0f243ecd-6943-4fe7-ab6d-5278787504e3] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:38.248957 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-7c7070a3-d93a-4ad5-aeb5-9d4b002eb798 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:38.264971 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-7c7070a3-d93a-4ad5-aeb5-9d4b002eb798 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1522 microversion: 2.1 time: 0.294120 Oct 18 11:41:38.266433 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 78/166] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:37 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:41:38.270990 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-9d097e16-863c-4b2b-a2b3-df20dcb6b351 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:38.271598 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-9d097e16-863c-4b2b-a2b3-df20dcb6b351 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: ce665d5a-e059-4547-a267-a9a86d89a9c9] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:38.291583 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9d097e16-863c-4b2b-a2b3-df20dcb6b351 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:38.292088 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9d097e16-863c-4b2b-a2b3-df20dcb6b351 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:38.292529 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9d097e16-863c-4b2b-a2b3-df20dcb6b351 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:38.296736 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9d097e16-863c-4b2b-a2b3-df20dcb6b351 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:38.297492 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9d097e16-863c-4b2b-a2b3-df20dcb6b351 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:38.298095 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9d097e16-863c-4b2b-a2b3-df20dcb6b351 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:38.418444 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-3b73c593-1c46-4711-b2e2-5555d83c370a tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f286fcc4b509485dbb958873a2207592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb846ed3b9141c694927b06b387b433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:38.442692 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-3b73c593-1c46-4711-b2e2-5555d83c370a tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] 10.222.0.17 "GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3" status: 200 len: 1213 microversion: 2.1 time: 0.274337 Oct 18 11:41:38.443307 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 89/167] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:38 2022] GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3 => generated 1213 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:38.637619 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-9d097e16-863c-4b2b-a2b3-df20dcb6b351 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:38.652602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-9d097e16-863c-4b2b-a2b3-df20dcb6b351 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9" status: 200 len: 1313 microversion: 2.1 time: 0.382989 Oct 18 11:41:38.654176 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 79/168] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:38 2022] GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9 => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:39.291607 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-4198fcba-73d5-4f28-92f2-1a801a3accec tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:39.292320 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-4198fcba-73d5-4f28-92f2-1a801a3accec tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:39.313815 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4198fcba-73d5-4f28-92f2-1a801a3accec tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:39.316572 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4198fcba-73d5-4f28-92f2-1a801a3accec tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:39.317447 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4198fcba-73d5-4f28-92f2-1a801a3accec tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:39.318976 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4198fcba-73d5-4f28-92f2-1a801a3accec tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:39.321123 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4198fcba-73d5-4f28-92f2-1a801a3accec tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:39.322078 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4198fcba-73d5-4f28-92f2-1a801a3accec tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:39.470440 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-6b7c2cbe-e566-4cd1-8b77-893d2aadccc0 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:39.472096 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-6b7c2cbe-e566-4cd1-8b77-893d2aadccc0 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] [instance: 0f243ecd-6943-4fe7-ab6d-5278787504e3] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:39.483772 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6b7c2cbe-e566-4cd1-8b77-893d2aadccc0 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:39.485924 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6b7c2cbe-e566-4cd1-8b77-893d2aadccc0 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:39.487266 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6b7c2cbe-e566-4cd1-8b77-893d2aadccc0 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:39.488594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6b7c2cbe-e566-4cd1-8b77-893d2aadccc0 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:39.489144 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6b7c2cbe-e566-4cd1-8b77-893d2aadccc0 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:39.489816 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6b7c2cbe-e566-4cd1-8b77-893d2aadccc0 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:39.604155 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-6b7c2cbe-e566-4cd1-8b77-893d2aadccc0 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f286fcc4b509485dbb958873a2207592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb846ed3b9141c694927b06b387b433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:39.623073 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-6b7c2cbe-e566-4cd1-8b77-893d2aadccc0 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] 10.222.0.17 "GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3" status: 200 len: 1265 microversion: 2.1 time: 0.157427 Oct 18 11:41:39.623668 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 80/169] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:39 2022] GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:41:39.690219 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-15bfa3c1-3829-4319-b1d4-fa6a08dd2d72 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:39.690219 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-15bfa3c1-3829-4319-b1d4-fa6a08dd2d72 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: ce665d5a-e059-4547-a267-a9a86d89a9c9] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:39.695494 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-15bfa3c1-3829-4319-b1d4-fa6a08dd2d72 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:39.696000 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-15bfa3c1-3829-4319-b1d4-fa6a08dd2d72 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:39.696674 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-15bfa3c1-3829-4319-b1d4-fa6a08dd2d72 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:39.697521 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-15bfa3c1-3829-4319-b1d4-fa6a08dd2d72 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:39.699871 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-15bfa3c1-3829-4319-b1d4-fa6a08dd2d72 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:39.700302 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-15bfa3c1-3829-4319-b1d4-fa6a08dd2d72 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:39.762763 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-4198fcba-73d5-4f28-92f2-1a801a3accec tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:39.789056 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-4198fcba-73d5-4f28-92f2-1a801a3accec tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1522 microversion: 2.1 time: 0.504301 Oct 18 11:41:39.790241 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 90/170] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:39 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1522 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:39.889604 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-15bfa3c1-3829-4319-b1d4-fa6a08dd2d72 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:39.901768 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-15bfa3c1-3829-4319-b1d4-fa6a08dd2d72 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9" status: 200 len: 1313 microversion: 2.1 time: 0.222096 Oct 18 11:41:39.902642 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 81/171] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:39 2022] GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:40.648645 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-99ca89c9-10b1-4b2f-9f2e-ca869b53f059 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:40.652397 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-99ca89c9-10b1-4b2f-9f2e-ca869b53f059 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] [instance: 0f243ecd-6943-4fe7-ab6d-5278787504e3] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:40.660374 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-99ca89c9-10b1-4b2f-9f2e-ca869b53f059 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:40.661158 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-99ca89c9-10b1-4b2f-9f2e-ca869b53f059 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:40.662022 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-99ca89c9-10b1-4b2f-9f2e-ca869b53f059 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:40.663146 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-99ca89c9-10b1-4b2f-9f2e-ca869b53f059 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:40.663821 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-99ca89c9-10b1-4b2f-9f2e-ca869b53f059 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:40.664699 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-99ca89c9-10b1-4b2f-9f2e-ca869b53f059 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:40.686260 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:41:40.753806 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-99ca89c9-10b1-4b2f-9f2e-ca869b53f059 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f286fcc4b509485dbb958873a2207592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb846ed3b9141c694927b06b387b433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:40.766635 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-99ca89c9-10b1-4b2f-9f2e-ca869b53f059 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] 10.222.0.17 "GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3" status: 200 len: 1271 microversion: 2.1 time: 0.119593 Oct 18 11:41:40.772776 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 91/172] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:40 2022] GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3 => generated 1271 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:40.816251 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-1d3d7c61-2532-48d0-a7ae-f7aba7453934 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:40.816251 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-1d3d7c61-2532-48d0-a7ae-f7aba7453934 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:40.820813 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1d3d7c61-2532-48d0-a7ae-f7aba7453934 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:40.821643 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1d3d7c61-2532-48d0-a7ae-f7aba7453934 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:40.822297 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1d3d7c61-2532-48d0-a7ae-f7aba7453934 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:40.823252 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1d3d7c61-2532-48d0-a7ae-f7aba7453934 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:40.824074 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1d3d7c61-2532-48d0-a7ae-f7aba7453934 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:40.824687 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1d3d7c61-2532-48d0-a7ae-f7aba7453934 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:40.925366 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-dbb109d4-0dc5-43e5-a08a-10391c642c02 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:40.926190 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-dbb109d4-0dc5-43e5-a08a-10391c642c02 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: ce665d5a-e059-4547-a267-a9a86d89a9c9] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:40.937540 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-dbb109d4-0dc5-43e5-a08a-10391c642c02 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:40.938043 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-dbb109d4-0dc5-43e5-a08a-10391c642c02 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:40.938489 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-dbb109d4-0dc5-43e5-a08a-10391c642c02 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:40.939199 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-dbb109d4-0dc5-43e5-a08a-10391c642c02 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:40.939648 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-dbb109d4-0dc5-43e5-a08a-10391c642c02 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:40.941461 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-dbb109d4-0dc5-43e5-a08a-10391c642c02 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:41.157920 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-1d3d7c61-2532-48d0-a7ae-f7aba7453934 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:41.187732 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-1d3d7c61-2532-48d0-a7ae-f7aba7453934 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1522 microversion: 2.1 time: 0.376062 Oct 18 11:41:41.190705 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 82/173] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:40 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:41.302142 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-dbb109d4-0dc5-43e5-a08a-10391c642c02 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:41.315369 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-dbb109d4-0dc5-43e5-a08a-10391c642c02 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9" status: 200 len: 1313 microversion: 2.1 time: 0.394209 Oct 18 11:41:41.335185 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 92/174] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:40 2022] GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9 => generated 1313 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:41.694166 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-faa84444-d651-4df3-8200-151839b6e249 req-eab96a0f-a78d-4e7d-a505-00dbf08078e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce665d5a-e059-4547-a267-a9a86d89a9c9", "name": "network-vif-plugged", "status": "completed", "tag": "1cb87854-891f-4219-898c-41598a9f4885"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:41:41.719193 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-faa84444-d651-4df3-8200-151839b6e249 req-eab96a0f-a78d-4e7d-a505-00dbf08078e3 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:41.719670 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-faa84444-d651-4df3-8200-151839b6e249 req-eab96a0f-a78d-4e7d-a505-00dbf08078e3 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:41.720094 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-faa84444-d651-4df3-8200-151839b6e249 req-eab96a0f-a78d-4e7d-a505-00dbf08078e3 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:41.738096 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-faa84444-d651-4df3-8200-151839b6e249 req-eab96a0f-a78d-4e7d-a505-00dbf08078e3 service nova] Creating event network-vif-plugged:1cb87854-891f-4219-898c-41598a9f4885 for instance ce665d5a-e059-4547-a267-a9a86d89a9c9 on hv-cinder-81558 Oct 18 11:41:41.766526 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-faa84444-d651-4df3-8200-151839b6e249 req-eab96a0f-a78d-4e7d-a505-00dbf08078e3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076731 Oct 18 11:41:41.769185 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 83/175] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:41:41.789577 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ffc14a00-7532-424b-be97-f97a4458b7a2 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:41.791132 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-ffc14a00-7532-424b-be97-f97a4458b7a2 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] [instance: 0f243ecd-6943-4fe7-ab6d-5278787504e3] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:41.802517 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ffc14a00-7532-424b-be97-f97a4458b7a2 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:41.804467 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ffc14a00-7532-424b-be97-f97a4458b7a2 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:41.804871 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ffc14a00-7532-424b-be97-f97a4458b7a2 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:41.805594 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ffc14a00-7532-424b-be97-f97a4458b7a2 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:41.806659 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ffc14a00-7532-424b-be97-f97a4458b7a2 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:41.807304 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ffc14a00-7532-424b-be97-f97a4458b7a2 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:41.919889 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-ffc14a00-7532-424b-be97-f97a4458b7a2 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f286fcc4b509485dbb958873a2207592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb846ed3b9141c694927b06b387b433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:41.928480 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-ffc14a00-7532-424b-be97-f97a4458b7a2 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] 10.222.0.17 "GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3" status: 200 len: 1271 microversion: 2.1 time: 0.142974 Oct 18 11:41:41.929432 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 93/176] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:41 2022] GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3 => generated 1271 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:42.219118 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-3ea12326-2cc9-428a-be10-aa0635ca2bbd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:42.219828 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-3ea12326-2cc9-428a-be10-aa0635ca2bbd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:42.256507 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3ea12326-2cc9-428a-be10-aa0635ca2bbd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:42.257267 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3ea12326-2cc9-428a-be10-aa0635ca2bbd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:42.257889 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3ea12326-2cc9-428a-be10-aa0635ca2bbd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:42.258760 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3ea12326-2cc9-428a-be10-aa0635ca2bbd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:42.259451 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3ea12326-2cc9-428a-be10-aa0635ca2bbd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:42.259817 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3ea12326-2cc9-428a-be10-aa0635ca2bbd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:42.350064 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-24f4b783-92ef-4707-9a5d-482be5a26190 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:42.350947 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-24f4b783-92ef-4707-9a5d-482be5a26190 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: ce665d5a-e059-4547-a267-a9a86d89a9c9] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:42.363991 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-24f4b783-92ef-4707-9a5d-482be5a26190 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:42.364824 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-24f4b783-92ef-4707-9a5d-482be5a26190 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:42.365455 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-24f4b783-92ef-4707-9a5d-482be5a26190 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:42.366341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-24f4b783-92ef-4707-9a5d-482be5a26190 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:42.366951 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-24f4b783-92ef-4707-9a5d-482be5a26190 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:42.367558 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-24f4b783-92ef-4707-9a5d-482be5a26190 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:42.573163 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-24f4b783-92ef-4707-9a5d-482be5a26190 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:42.580955 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-24f4b783-92ef-4707-9a5d-482be5a26190 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9" status: 200 len: 1313 microversion: 2.1 time: 0.239392 Oct 18 11:41:42.581529 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 94/177] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:42 2022] GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:42.629677 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-3ea12326-2cc9-428a-be10-aa0635ca2bbd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:42.641064 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-3ea12326-2cc9-428a-be10-aa0635ca2bbd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1522 microversion: 2.1 time: 0.426311 Oct 18 11:41:42.641699 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 84/178] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:42 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1522 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:42.966528 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-369d4ef7-f840-4932-9e43-a874efd66c5e tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:42.967240 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-369d4ef7-f840-4932-9e43-a874efd66c5e tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] [instance: 0f243ecd-6943-4fe7-ab6d-5278787504e3] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:42.979278 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-369d4ef7-f840-4932-9e43-a874efd66c5e tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:42.980141 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-369d4ef7-f840-4932-9e43-a874efd66c5e tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:42.980585 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-369d4ef7-f840-4932-9e43-a874efd66c5e tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:42.981648 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-369d4ef7-f840-4932-9e43-a874efd66c5e tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:42.982012 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-369d4ef7-f840-4932-9e43-a874efd66c5e tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:42.982706 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-369d4ef7-f840-4932-9e43-a874efd66c5e tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:43.188240 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-369d4ef7-f840-4932-9e43-a874efd66c5e tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f286fcc4b509485dbb958873a2207592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb846ed3b9141c694927b06b387b433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:43.198568 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-369d4ef7-f840-4932-9e43-a874efd66c5e tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] 10.222.0.17 "GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3" status: 200 len: 1313 microversion: 2.1 time: 0.244427 Oct 18 11:41:43.199438 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 95/179] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:42 2022] GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:43.517501 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-3b35d0b9-f04c-4029-b061-bf3a7bc7c2b6 req-8324f3a8-a514-4eb3-853d-82573d7fd488 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f243ecd-6943-4fe7-ab6d-5278787504e3", "tag": "15540fea-acab-4d31-91a0-3966b2b505f6"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:41:43.527066 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell0:SELECT=2 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:41:43.527987 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell0:SELECT=6 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:41:43.544324 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-3b35d0b9-f04c-4029-b061-bf3a7bc7c2b6 req-8324f3a8-a514-4eb3-853d-82573d7fd488 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:43.548403 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-3b35d0b9-f04c-4029-b061-bf3a7bc7c2b6 req-8324f3a8-a514-4eb3-853d-82573d7fd488 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:43.549029 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-3b35d0b9-f04c-4029-b061-bf3a7bc7c2b6 req-8324f3a8-a514-4eb3-853d-82573d7fd488 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:43.570078 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-3b35d0b9-f04c-4029-b061-bf3a7bc7c2b6 req-8324f3a8-a514-4eb3-853d-82573d7fd488 service nova] Creating event network-changed:15540fea-acab-4d31-91a0-3966b2b505f6 for instance 0f243ecd-6943-4fe7-ab6d-5278787504e3 on hv-cinder-81558 Oct 18 11:41:43.575165 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-3b35d0b9-f04c-4029-b061-bf3a7bc7c2b6 req-8324f3a8-a514-4eb3-853d-82573d7fd488 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062194 Oct 18 11:41:43.576142 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 85/180] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:41:43.621522 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-e1a698ab-33fa-404a-bf53-203de41f4c5d tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:43.623130 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-e1a698ab-33fa-404a-bf53-203de41f4c5d tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: ce665d5a-e059-4547-a267-a9a86d89a9c9] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:43.632020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e1a698ab-33fa-404a-bf53-203de41f4c5d tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:43.632786 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e1a698ab-33fa-404a-bf53-203de41f4c5d tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:43.633694 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e1a698ab-33fa-404a-bf53-203de41f4c5d tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:43.635335 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e1a698ab-33fa-404a-bf53-203de41f4c5d tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:43.636046 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e1a698ab-33fa-404a-bf53-203de41f4c5d tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:43.636917 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e1a698ab-33fa-404a-bf53-203de41f4c5d tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:43.666097 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-cf3ac91c-f611-4db2-bf87-3cda80f56f1f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:43.667183 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-cf3ac91c-f611-4db2-bf87-3cda80f56f1f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:43.678666 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cf3ac91c-f611-4db2-bf87-3cda80f56f1f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:43.679158 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cf3ac91c-f611-4db2-bf87-3cda80f56f1f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:43.679653 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cf3ac91c-f611-4db2-bf87-3cda80f56f1f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:43.680263 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cf3ac91c-f611-4db2-bf87-3cda80f56f1f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:43.680740 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cf3ac91c-f611-4db2-bf87-3cda80f56f1f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:43.682838 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cf3ac91c-f611-4db2-bf87-3cda80f56f1f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:43.865841 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-e1a698ab-33fa-404a-bf53-203de41f4c5d tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:43.874063 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-e1a698ab-33fa-404a-bf53-203de41f4c5d tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9" status: 200 len: 1313 microversion: 2.1 time: 0.268428 Oct 18 11:41:43.874874 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 96/181] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:43 2022] GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9 => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:43.944137 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-cf3ac91c-f611-4db2-bf87-3cda80f56f1f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:43.952828 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-cf3ac91c-f611-4db2-bf87-3cda80f56f1f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1522 microversion: 2.1 time: 0.291600 Oct 18 11:41:43.953710 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 86/182] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:43 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:41:44.222752 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-d1b638b9-ae4b-42cc-bf14-269006387faf tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:44.224174 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-d1b638b9-ae4b-42cc-bf14-269006387faf tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] [instance: 0f243ecd-6943-4fe7-ab6d-5278787504e3] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:44.231723 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d1b638b9-ae4b-42cc-bf14-269006387faf tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:44.232288 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d1b638b9-ae4b-42cc-bf14-269006387faf tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:44.233747 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d1b638b9-ae4b-42cc-bf14-269006387faf tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:44.234657 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d1b638b9-ae4b-42cc-bf14-269006387faf tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:44.235293 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d1b638b9-ae4b-42cc-bf14-269006387faf tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:44.235897 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d1b638b9-ae4b-42cc-bf14-269006387faf tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:44.413442 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-d1b638b9-ae4b-42cc-bf14-269006387faf tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f286fcc4b509485dbb958873a2207592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb846ed3b9141c694927b06b387b433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:44.424068 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-d1b638b9-ae4b-42cc-bf14-269006387faf tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] 10.222.0.17 "GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3" status: 200 len: 1313 microversion: 2.1 time: 0.205889 Oct 18 11:41:44.425447 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 97/183] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:44 2022] GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:44.906960 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-ad5f842e-5f8e-4cf1-bf54-73fc5ac49cfe tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:44.909948 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-ad5f842e-5f8e-4cf1-bf54-73fc5ac49cfe tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: ce665d5a-e059-4547-a267-a9a86d89a9c9] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:44.932212 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ad5f842e-5f8e-4cf1-bf54-73fc5ac49cfe tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:44.938972 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ad5f842e-5f8e-4cf1-bf54-73fc5ac49cfe tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:44.939519 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ad5f842e-5f8e-4cf1-bf54-73fc5ac49cfe tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:44.941683 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ad5f842e-5f8e-4cf1-bf54-73fc5ac49cfe tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:44.942254 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ad5f842e-5f8e-4cf1-bf54-73fc5ac49cfe tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:44.946553 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ad5f842e-5f8e-4cf1-bf54-73fc5ac49cfe tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:44.976972 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-59b5969b-b622-4fcb-8d53-3a993c286c79 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:44.980562 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-59b5969b-b622-4fcb-8d53-3a993c286c79 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:45.003794 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-59b5969b-b622-4fcb-8d53-3a993c286c79 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:45.004686 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-59b5969b-b622-4fcb-8d53-3a993c286c79 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:45.005033 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-59b5969b-b622-4fcb-8d53-3a993c286c79 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:45.005745 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-59b5969b-b622-4fcb-8d53-3a993c286c79 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:45.006205 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-59b5969b-b622-4fcb-8d53-3a993c286c79 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:45.006631 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-59b5969b-b622-4fcb-8d53-3a993c286c79 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:45.191795 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-ad5f842e-5f8e-4cf1-bf54-73fc5ac49cfe tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:45.202906 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-ad5f842e-5f8e-4cf1-bf54-73fc5ac49cfe tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9" status: 200 len: 1497 microversion: 2.1 time: 0.308723 Oct 18 11:41:45.203805 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 87/184] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:44 2022] GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9 => generated 1497 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:45.448700 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-f45db33f-ea2f-4132-a3a6-bda9d19a0965 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:45.449283 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-f45db33f-ea2f-4132-a3a6-bda9d19a0965 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] [instance: 0f243ecd-6943-4fe7-ab6d-5278787504e3] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:45.460772 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f45db33f-ea2f-4132-a3a6-bda9d19a0965 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:45.461652 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f45db33f-ea2f-4132-a3a6-bda9d19a0965 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:45.462892 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f45db33f-ea2f-4132-a3a6-bda9d19a0965 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:45.464203 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f45db33f-ea2f-4132-a3a6-bda9d19a0965 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:45.466153 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f45db33f-ea2f-4132-a3a6-bda9d19a0965 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:45.466930 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f45db33f-ea2f-4132-a3a6-bda9d19a0965 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:45.470032 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-59b5969b-b622-4fcb-8d53-3a993c286c79 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:45.483575 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-59b5969b-b622-4fcb-8d53-3a993c286c79 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1522 microversion: 2.1 time: 0.510404 Oct 18 11:41:45.486771 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 98/185] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:44 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1522 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:45.653289 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-f45db33f-ea2f-4132-a3a6-bda9d19a0965 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f286fcc4b509485dbb958873a2207592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb846ed3b9141c694927b06b387b433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:45.661442 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-f45db33f-ea2f-4132-a3a6-bda9d19a0965 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] 10.222.0.17 "GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3" status: 200 len: 1313 microversion: 2.1 time: 0.217724 Oct 18 11:41:45.662340 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 88/186] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:45 2022] GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:41:45.905368 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-008a3fcd-3eda-455a-aef5-ef2dc6f9d094 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:45.906147 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-008a3fcd-3eda-455a-aef5-ef2dc6f9d094 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: ce665d5a-e059-4547-a267-a9a86d89a9c9] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:45.916641 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-008a3fcd-3eda-455a-aef5-ef2dc6f9d094 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:45.917991 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-008a3fcd-3eda-455a-aef5-ef2dc6f9d094 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:45.919291 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-008a3fcd-3eda-455a-aef5-ef2dc6f9d094 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:45.920199 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-008a3fcd-3eda-455a-aef5-ef2dc6f9d094 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:45.921014 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-008a3fcd-3eda-455a-aef5-ef2dc6f9d094 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:45.921439 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-008a3fcd-3eda-455a-aef5-ef2dc6f9d094 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:45.949199 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-008a3fcd-3eda-455a-aef5-ef2dc6f9d094 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: ce665d5a-e059-4547-a267-a9a86d89a9c9] Going to try to terminate instance {{(pid=125485) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 11:41:46.057320 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-008a3fcd-3eda-455a-aef5-ef2dc6f9d094 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9" status: 204 len: 0 microversion: 2.1 time: 0.155923 Oct 18 11:41:46.062307 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 99/187] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Oct 18 11:41:45 2022] DELETE /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 11:41:46.066694 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-4a165cce-d33c-45c0-a8f8-d2d9c835d5d6 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:46.068055 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-4a165cce-d33c-45c0-a8f8-d2d9c835d5d6 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: ce665d5a-e059-4547-a267-a9a86d89a9c9] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:46.075839 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4a165cce-d33c-45c0-a8f8-d2d9c835d5d6 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:46.076416 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4a165cce-d33c-45c0-a8f8-d2d9c835d5d6 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:46.077345 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4a165cce-d33c-45c0-a8f8-d2d9c835d5d6 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:46.078451 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4a165cce-d33c-45c0-a8f8-d2d9c835d5d6 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:46.078911 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4a165cce-d33c-45c0-a8f8-d2d9c835d5d6 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:46.079333 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4a165cce-d33c-45c0-a8f8-d2d9c835d5d6 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:46.236126 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-4a165cce-d33c-45c0-a8f8-d2d9c835d5d6 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:46.244593 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-4a165cce-d33c-45c0-a8f8-d2d9c835d5d6 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9" status: 200 len: 1503 microversion: 2.1 time: 0.181888 Oct 18 11:41:46.245220 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 89/188] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:46 2022] GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9 => generated 1503 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:46.515171 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-2f4ee2f4-dae4-4e6f-b4ad-2da0414c39bb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:46.517398 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-2f4ee2f4-dae4-4e6f-b4ad-2da0414c39bb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:46.525982 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2f4ee2f4-dae4-4e6f-b4ad-2da0414c39bb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:46.526645 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2f4ee2f4-dae4-4e6f-b4ad-2da0414c39bb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:46.527078 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2f4ee2f4-dae4-4e6f-b4ad-2da0414c39bb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:46.527780 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2f4ee2f4-dae4-4e6f-b4ad-2da0414c39bb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:46.528403 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2f4ee2f4-dae4-4e6f-b4ad-2da0414c39bb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:46.528820 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2f4ee2f4-dae4-4e6f-b4ad-2da0414c39bb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:46.683801 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-8f7d2974-b96e-43eb-a7f4-22ea2205b3c8 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:46.686932 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-8f7d2974-b96e-43eb-a7f4-22ea2205b3c8 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] [instance: 0f243ecd-6943-4fe7-ab6d-5278787504e3] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:46.693859 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8f7d2974-b96e-43eb-a7f4-22ea2205b3c8 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:46.694484 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8f7d2974-b96e-43eb-a7f4-22ea2205b3c8 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:46.695167 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8f7d2974-b96e-43eb-a7f4-22ea2205b3c8 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:46.696077 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8f7d2974-b96e-43eb-a7f4-22ea2205b3c8 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:46.697380 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8f7d2974-b96e-43eb-a7f4-22ea2205b3c8 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:46.698054 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8f7d2974-b96e-43eb-a7f4-22ea2205b3c8 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:46.882945 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-2f4ee2f4-dae4-4e6f-b4ad-2da0414c39bb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:46.894133 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-2f4ee2f4-dae4-4e6f-b4ad-2da0414c39bb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1522 microversion: 2.1 time: 0.382999 Oct 18 11:41:46.906767 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 100/189] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:46 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:46.915185 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-8f7d2974-b96e-43eb-a7f4-22ea2205b3c8 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f286fcc4b509485dbb958873a2207592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb846ed3b9141c694927b06b387b433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:46.932677 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-8f7d2974-b96e-43eb-a7f4-22ea2205b3c8 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] 10.222.0.17 "GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3" status: 200 len: 1313 microversion: 2.1 time: 0.252642 Oct 18 11:41:46.933664 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 90/190] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:46 2022] GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:47.271210 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-876dc19d-1ed6-47aa-b1a9-99f6ca381b73 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:47.272128 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-876dc19d-1ed6-47aa-b1a9-99f6ca381b73 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: ce665d5a-e059-4547-a267-a9a86d89a9c9] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:47.282107 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-876dc19d-1ed6-47aa-b1a9-99f6ca381b73 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:47.282587 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-876dc19d-1ed6-47aa-b1a9-99f6ca381b73 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:47.283013 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-876dc19d-1ed6-47aa-b1a9-99f6ca381b73 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:47.284979 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-876dc19d-1ed6-47aa-b1a9-99f6ca381b73 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:47.290965 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-876dc19d-1ed6-47aa-b1a9-99f6ca381b73 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:47.291423 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-876dc19d-1ed6-47aa-b1a9-99f6ca381b73 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:47.588762 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-876dc19d-1ed6-47aa-b1a9-99f6ca381b73 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:47.598271 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-876dc19d-1ed6-47aa-b1a9-99f6ca381b73 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9" status: 200 len: 1503 microversion: 2.1 time: 0.333437 Oct 18 11:41:47.598870 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 101/191] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:47 2022] GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9 => generated 1503 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:47.917834 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-1e386de0-b03a-40f0-9d39-fd3c002ca475 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:47.923731 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-1e386de0-b03a-40f0-9d39-fd3c002ca475 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:47.931305 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1e386de0-b03a-40f0-9d39-fd3c002ca475 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:47.931979 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1e386de0-b03a-40f0-9d39-fd3c002ca475 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:47.932703 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1e386de0-b03a-40f0-9d39-fd3c002ca475 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:47.933558 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1e386de0-b03a-40f0-9d39-fd3c002ca475 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:47.939626 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1e386de0-b03a-40f0-9d39-fd3c002ca475 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:47.940297 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1e386de0-b03a-40f0-9d39-fd3c002ca475 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:47.959394 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-f5f3bd34-ff5c-4cea-9953-2774077a7596 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:47.960198 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-f5f3bd34-ff5c-4cea-9953-2774077a7596 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] [instance: 0f243ecd-6943-4fe7-ab6d-5278787504e3] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:47.961041 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell1:SELECT=100 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:41:47.978595 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f5f3bd34-ff5c-4cea-9953-2774077a7596 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:47.979258 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f5f3bd34-ff5c-4cea-9953-2774077a7596 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:47.979789 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f5f3bd34-ff5c-4cea-9953-2774077a7596 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:47.980758 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f5f3bd34-ff5c-4cea-9953-2774077a7596 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:47.981379 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f5f3bd34-ff5c-4cea-9953-2774077a7596 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:47.983368 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f5f3bd34-ff5c-4cea-9953-2774077a7596 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:48.008560 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell0:SELECT=2 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:41:48.146761 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-f5f3bd34-ff5c-4cea-9953-2774077a7596 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f286fcc4b509485dbb958873a2207592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb846ed3b9141c694927b06b387b433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:48.155752 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-f5f3bd34-ff5c-4cea-9953-2774077a7596 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] 10.222.0.17 "GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3" status: 200 len: 1313 microversion: 2.1 time: 0.204085 Oct 18 11:41:48.156555 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 102/192] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:47 2022] GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:41:48.188527 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-1e386de0-b03a-40f0-9d39-fd3c002ca475 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:48.198853 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-1e386de0-b03a-40f0-9d39-fd3c002ca475 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1522 microversion: 2.1 time: 0.284788 Oct 18 11:41:48.200039 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 91/193] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:47 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:48.622171 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-221b35b0-d636-48c7-a2ce-85081ec2b694 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:48.622783 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-221b35b0-d636-48c7-a2ce-85081ec2b694 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: ce665d5a-e059-4547-a267-a9a86d89a9c9] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:48.625392 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell0:SELECT=10 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:41:48.643116 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-221b35b0-d636-48c7-a2ce-85081ec2b694 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:48.645014 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-221b35b0-d636-48c7-a2ce-85081ec2b694 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:48.645014 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-221b35b0-d636-48c7-a2ce-85081ec2b694 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:48.645014 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-221b35b0-d636-48c7-a2ce-85081ec2b694 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:48.645320 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-221b35b0-d636-48c7-a2ce-85081ec2b694 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:48.645598 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-221b35b0-d636-48c7-a2ce-85081ec2b694 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:48.827059 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-221b35b0-d636-48c7-a2ce-85081ec2b694 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:48.836057 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-221b35b0-d636-48c7-a2ce-85081ec2b694 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9" status: 200 len: 1503 microversion: 2.1 time: 0.218138 Oct 18 11:41:48.838918 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 103/194] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:48 2022] GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9 => generated 1503 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:49.187225 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-54d94cca-e6e3-4eb0-8127-5fc618ce4732 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:49.188468 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-54d94cca-e6e3-4eb0-8127-5fc618ce4732 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] [instance: 0f243ecd-6943-4fe7-ab6d-5278787504e3] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:49.211226 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-54d94cca-e6e3-4eb0-8127-5fc618ce4732 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:49.212472 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-54d94cca-e6e3-4eb0-8127-5fc618ce4732 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:49.213569 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-54d94cca-e6e3-4eb0-8127-5fc618ce4732 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:49.223902 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-4b700a15-e8ad-46c0-a687-3547901a6aca tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:49.224086 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-4b700a15-e8ad-46c0-a687-3547901a6aca tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:49.230084 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-54d94cca-e6e3-4eb0-8127-5fc618ce4732 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:49.231137 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4b700a15-e8ad-46c0-a687-3547901a6aca tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:49.231625 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4b700a15-e8ad-46c0-a687-3547901a6aca tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:49.232056 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4b700a15-e8ad-46c0-a687-3547901a6aca tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:49.232751 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4b700a15-e8ad-46c0-a687-3547901a6aca tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:49.233375 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4b700a15-e8ad-46c0-a687-3547901a6aca tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:49.233541 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-54d94cca-e6e3-4eb0-8127-5fc618ce4732 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:49.234142 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4b700a15-e8ad-46c0-a687-3547901a6aca tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:49.234477 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-54d94cca-e6e3-4eb0-8127-5fc618ce4732 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:49.445841 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-4b700a15-e8ad-46c0-a687-3547901a6aca tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:49.461651 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-4b700a15-e8ad-46c0-a687-3547901a6aca tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1522 microversion: 2.1 time: 0.242567 Oct 18 11:41:49.463983 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 104/195] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:49 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:41:49.728210 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-54d94cca-e6e3-4eb0-8127-5fc618ce4732 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f286fcc4b509485dbb958873a2207592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb846ed3b9141c694927b06b387b433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:49.739077 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-54d94cca-e6e3-4eb0-8127-5fc618ce4732 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] 10.222.0.17 "GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3" status: 200 len: 1313 microversion: 2.1 time: 0.562238 Oct 18 11:41:49.740148 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 92/196] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:49 2022] GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3 => generated 1313 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:49.864282 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-eccbb6b0-36ac-400b-b115-308671429d9e tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:49.865080 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-eccbb6b0-36ac-400b-b115-308671429d9e tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: ce665d5a-e059-4547-a267-a9a86d89a9c9] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:49.866532 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:41:49.889516 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-ba94eb13-e343-4cc9-b932-c22085ca6e45 req-e4580d10-575d-46bf-8fa0-2b87953b5fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f243ecd-6943-4fe7-ab6d-5278787504e3", "name": "network-vif-plugged", "status": "completed", "tag": "15540fea-acab-4d31-91a0-3966b2b505f6"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:41:49.892740 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-eccbb6b0-36ac-400b-b115-308671429d9e tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:49.893304 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-eccbb6b0-36ac-400b-b115-308671429d9e tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:49.893801 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-eccbb6b0-36ac-400b-b115-308671429d9e tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:49.894518 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-eccbb6b0-36ac-400b-b115-308671429d9e tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:49.894971 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-eccbb6b0-36ac-400b-b115-308671429d9e tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:49.896328 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-eccbb6b0-36ac-400b-b115-308671429d9e tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:49.906521 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-ba94eb13-e343-4cc9-b932-c22085ca6e45 req-e4580d10-575d-46bf-8fa0-2b87953b5fe3 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:49.907513 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-ba94eb13-e343-4cc9-b932-c22085ca6e45 req-e4580d10-575d-46bf-8fa0-2b87953b5fe3 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:49.908222 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-ba94eb13-e343-4cc9-b932-c22085ca6e45 req-e4580d10-575d-46bf-8fa0-2b87953b5fe3 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:49.922347 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-ba94eb13-e343-4cc9-b932-c22085ca6e45 req-e4580d10-575d-46bf-8fa0-2b87953b5fe3 service nova] Creating event network-vif-plugged:15540fea-acab-4d31-91a0-3966b2b505f6 for instance 0f243ecd-6943-4fe7-ab6d-5278787504e3 on hv-cinder-81558 Oct 18 11:41:49.929089 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-ba94eb13-e343-4cc9-b932-c22085ca6e45 req-e4580d10-575d-46bf-8fa0-2b87953b5fe3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043362 Oct 18 11:41:49.931075 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 93/197] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:41:50.148467 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-eccbb6b0-36ac-400b-b115-308671429d9e tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:50.161120 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-eccbb6b0-36ac-400b-b115-308671429d9e tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9" status: 200 len: 1503 microversion: 2.1 time: 0.301926 Oct 18 11:41:50.161917 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 105/198] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:49 2022] GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9 => generated 1503 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:50.490545 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-a01f7ec0-168b-47c9-a433-2d44a2892cfb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:50.491016 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-a01f7ec0-168b-47c9-a433-2d44a2892cfb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:50.515450 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a01f7ec0-168b-47c9-a433-2d44a2892cfb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:50.516171 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a01f7ec0-168b-47c9-a433-2d44a2892cfb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:50.516760 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a01f7ec0-168b-47c9-a433-2d44a2892cfb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:50.517661 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a01f7ec0-168b-47c9-a433-2d44a2892cfb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:50.518267 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a01f7ec0-168b-47c9-a433-2d44a2892cfb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:50.519006 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a01f7ec0-168b-47c9-a433-2d44a2892cfb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:50.692935 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-ca3e7d51-a7b6-46f9-bcae-581d4c8f9872 req-99ea70ad-03c9-4ca1-809a-f06840dae69c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce665d5a-e059-4547-a267-a9a86d89a9c9", "name": "network-vif-deleted", "tag": "1cb87854-891f-4219-898c-41598a9f4885"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:41:50.705762 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-ca3e7d51-a7b6-46f9-bcae-581d4c8f9872 req-99ea70ad-03c9-4ca1-809a-f06840dae69c service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:50.706244 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-ca3e7d51-a7b6-46f9-bcae-581d4c8f9872 req-99ea70ad-03c9-4ca1-809a-f06840dae69c service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:50.706660 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-ca3e7d51-a7b6-46f9-bcae-581d4c8f9872 req-99ea70ad-03c9-4ca1-809a-f06840dae69c service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:50.722338 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-ca3e7d51-a7b6-46f9-bcae-581d4c8f9872 req-99ea70ad-03c9-4ca1-809a-f06840dae69c service nova] Creating event network-vif-deleted:1cb87854-891f-4219-898c-41598a9f4885 for instance ce665d5a-e059-4547-a267-a9a86d89a9c9 on hv-cinder-81558 Oct 18 11:41:50.727801 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-ca3e7d51-a7b6-46f9-bcae-581d4c8f9872 req-99ea70ad-03c9-4ca1-809a-f06840dae69c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045003 Oct 18 11:41:50.728992 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 106/199] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:41:50.757842 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-a01f7ec0-168b-47c9-a433-2d44a2892cfb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:50.763274 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-dfec2cda-6004-4227-8bd3-556ca91b241b tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:50.763967 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-dfec2cda-6004-4227-8bd3-556ca91b241b tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] [instance: 0f243ecd-6943-4fe7-ab6d-5278787504e3] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:50.770452 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-a01f7ec0-168b-47c9-a433-2d44a2892cfb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1522 microversion: 2.1 time: 0.283734 Oct 18 11:41:50.770628 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-dfec2cda-6004-4227-8bd3-556ca91b241b tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:50.770733 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-dfec2cda-6004-4227-8bd3-556ca91b241b tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:50.771036 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 94/200] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:50 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:50.771140 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-dfec2cda-6004-4227-8bd3-556ca91b241b tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:50.771822 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-dfec2cda-6004-4227-8bd3-556ca91b241b tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:50.772272 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-dfec2cda-6004-4227-8bd3-556ca91b241b tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:50.772687 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-dfec2cda-6004-4227-8bd3-556ca91b241b tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:50.777802 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:41:50.981997 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-dfec2cda-6004-4227-8bd3-556ca91b241b tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f286fcc4b509485dbb958873a2207592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb846ed3b9141c694927b06b387b433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:50.990510 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-dfec2cda-6004-4227-8bd3-556ca91b241b tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] 10.222.0.17 "GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3" status: 200 len: 1313 microversion: 2.1 time: 0.232277 Oct 18 11:41:50.991410 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 107/201] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:50 2022] GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:41:51.063581 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-7a71301d-f004-4acf-bbc0-6725ffc0e6d4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Action: 'create', calling method: .version_select at 0x7f4be0136280>, body: {"keypair": {"name": "tempest-keypair-1381857059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2Kpk6C2+IxZwKVgUB0/lqzmRpaCVV3KTtWBE1KueytEfCUGlMcz7Dgt9gfo/+/fZIIX0blW/TbrDF4FKbELY2VvYnXKK4LdNeHarVjnZsVn+3YMtTcuq5Ob4pN3Q6rlw=="}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:41:51.088693 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-7a71301d-f004-4acf-bbc0-6725ffc0e6d4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Getting quotas for project c84cfe68e5db4b2dba60443b48d23097. Resources: {'key_pairs'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:41:51.093649 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-7a71301d-f004-4acf-bbc0-6725ffc0e6d4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Getting quotas for user 72d748ebce2742058757304095d1a641 and project c84cfe68e5db4b2dba60443b48d23097. Resources: {'key_pairs'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:41:51.138215 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-7a71301d-f004-4acf-bbc0-6725ffc0e6d4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.277319 Oct 18 11:41:51.139090 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 95/202] 10.222.0.17 () {62 vars in 1200 bytes} [Tue Oct 18 11:41:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 279 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 18 11:41:51.196006 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-4859f38f-d19c-47ae-b2e9-82d47f7023a5 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:51.196830 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-4859f38f-d19c-47ae-b2e9-82d47f7023a5 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: ce665d5a-e059-4547-a267-a9a86d89a9c9] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:51.204283 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4859f38f-d19c-47ae-b2e9-82d47f7023a5 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:51.205267 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4859f38f-d19c-47ae-b2e9-82d47f7023a5 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:51.205929 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4859f38f-d19c-47ae-b2e9-82d47f7023a5 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:51.206799 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4859f38f-d19c-47ae-b2e9-82d47f7023a5 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:51.207428 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4859f38f-d19c-47ae-b2e9-82d47f7023a5 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:51.208154 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4859f38f-d19c-47ae-b2e9-82d47f7023a5 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:51.280121 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-4859f38f-d19c-47ae-b2e9-82d47f7023a5 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:51.288513 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-4859f38f-d19c-47ae-b2e9-82d47f7023a5 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9" status: 200 len: 1461 microversion: 2.1 time: 0.096821 Oct 18 11:41:51.289374 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 108/203] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:51 2022] GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9 => generated 1461 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:51.796116 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-8c5a80e8-4508-4863-aaff-43d2d6cbc012 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:51.796646 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-8c5a80e8-4508-4863-aaff-43d2d6cbc012 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:51.803191 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8c5a80e8-4508-4863-aaff-43d2d6cbc012 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:51.803722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8c5a80e8-4508-4863-aaff-43d2d6cbc012 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:51.804980 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8c5a80e8-4508-4863-aaff-43d2d6cbc012 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:51.806209 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8c5a80e8-4508-4863-aaff-43d2d6cbc012 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:51.806674 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8c5a80e8-4508-4863-aaff-43d2d6cbc012 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:51.807137 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8c5a80e8-4508-4863-aaff-43d2d6cbc012 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:51.953562 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-8c5a80e8-4508-4863-aaff-43d2d6cbc012 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:51.968719 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-8c5a80e8-4508-4863-aaff-43d2d6cbc012 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1502 microversion: 2.1 time: 0.176739 Oct 18 11:41:51.969372 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 96/204] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:51 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1502 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:41:51.990828 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-cf596fbd-cf63-4155-9d51-caec24f6276c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:51.991509 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-cf596fbd-cf63-4155-9d51-caec24f6276c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:51.997778 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cf596fbd-cf63-4155-9d51-caec24f6276c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:51.998267 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cf596fbd-cf63-4155-9d51-caec24f6276c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:51.998694 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cf596fbd-cf63-4155-9d51-caec24f6276c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:51.999395 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cf596fbd-cf63-4155-9d51-caec24f6276c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:51.999865 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cf596fbd-cf63-4155-9d51-caec24f6276c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:52.000323 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cf596fbd-cf63-4155-9d51-caec24f6276c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:52.018712 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-0c8851d0-dea5-431c-8f26-60f78510d728 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:52.019592 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-0c8851d0-dea5-431c-8f26-60f78510d728 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] [instance: 0f243ecd-6943-4fe7-ab6d-5278787504e3] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:52.027754 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0c8851d0-dea5-431c-8f26-60f78510d728 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:52.028242 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0c8851d0-dea5-431c-8f26-60f78510d728 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:52.028673 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0c8851d0-dea5-431c-8f26-60f78510d728 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:52.029726 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0c8851d0-dea5-431c-8f26-60f78510d728 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:52.030533 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0c8851d0-dea5-431c-8f26-60f78510d728 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:52.031141 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0c8851d0-dea5-431c-8f26-60f78510d728 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:52.225431 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-0c8851d0-dea5-431c-8f26-60f78510d728 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f286fcc4b509485dbb958873a2207592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb846ed3b9141c694927b06b387b433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:52.236037 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-cf596fbd-cf63-4155-9d51-caec24f6276c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:52.237059 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-0c8851d0-dea5-431c-8f26-60f78510d728 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] 10.222.0.17 "GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3" status: 200 len: 1313 microversion: 2.1 time: 0.224089 Oct 18 11:41:52.238139 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 97/205] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:52 2022] GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:52.245370 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-cf596fbd-cf63-4155-9d51-caec24f6276c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b" status: 200 len: 1516 microversion: 2.1 time: 0.258331 Oct 18 11:41:52.245949 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 109/206] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:51 2022] GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b => generated 1516 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:52.314313 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-5ae5de5a-652a-4d25-89e1-90ca7c537f72 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:52.315718 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-5ae5de5a-652a-4d25-89e1-90ca7c537f72 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: ce665d5a-e059-4547-a267-a9a86d89a9c9] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:52.323621 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5ae5de5a-652a-4d25-89e1-90ca7c537f72 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:52.324441 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5ae5de5a-652a-4d25-89e1-90ca7c537f72 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:52.325109 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5ae5de5a-652a-4d25-89e1-90ca7c537f72 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:52.326005 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5ae5de5a-652a-4d25-89e1-90ca7c537f72 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:52.326449 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5ae5de5a-652a-4d25-89e1-90ca7c537f72 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:52.327009 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5ae5de5a-652a-4d25-89e1-90ca7c537f72 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:52.361891 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5ae5de5a-652a-4d25-89e1-90ca7c537f72 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:52.362407 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5ae5de5a-652a-4d25-89e1-90ca7c537f72 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:52.363168 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5ae5de5a-652a-4d25-89e1-90ca7c537f72 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:52.363758 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.objects.instance [None req-5ae5de5a-652a-4d25-89e1-90ca7c537f72 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lazy-loading 'fault' on Instance uuid ce665d5a-e059-4547-a267-a9a86d89a9c9 {{(pid=125486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:41:52.459311 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-5ae5de5a-652a-4d25-89e1-90ca7c537f72 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:52.471428 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-5ae5de5a-652a-4d25-89e1-90ca7c537f72 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9" status: 200 len: 1303 microversion: 2.1 time: 0.161073 Oct 18 11:41:52.488891 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 98/207] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:52 2022] GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9 => generated 1303 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:52.657746 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-4c3a9cb9-ba34-4fc8-aeb2-a8f66ad9553e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1086858105", "imageRef": "a4917b56-ebe0-409a-894a-469900c12b94", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fea5d1fc-e591-4b70-83db-447fa0d3a485"}], "security_groups": [{"name": "tempest-securitygroup--58644855"}], "key_name": "tempest-keypair-1381857059", "user_data": "}} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:41:52.788804 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.network.neutron [None req-4c3a9cb9-ba34-4fc8-aeb2-a8f66ad9553e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] validate_networks() for [('fea5d1fc-e591-4b70-83db-447fa0d3a485', None, None, None, None, None)] {{(pid=125485) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 11:41:53.265524 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-f5254175-ac73-4bbe-a140-d04315942dca tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:53.266129 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-f5254175-ac73-4bbe-a140-d04315942dca tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] [instance: 0f243ecd-6943-4fe7-ab6d-5278787504e3] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:53.278196 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f5254175-ac73-4bbe-a140-d04315942dca tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:53.279013 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f5254175-ac73-4bbe-a140-d04315942dca tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:53.279851 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f5254175-ac73-4bbe-a140-d04315942dca tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:53.281835 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f5254175-ac73-4bbe-a140-d04315942dca tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:53.282576 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f5254175-ac73-4bbe-a140-d04315942dca tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:53.283507 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f5254175-ac73-4bbe-a140-d04315942dca tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:53.470322 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-4c3a9cb9-ba34-4fc8-aeb2-a8f66ad9553e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Flavor limits 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 11:41:53.471269 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-4c3a9cb9-ba34-4fc8-aeb2-a8f66ad9553e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Image limits 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 11:41:53.471918 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-4c3a9cb9-ba34-4fc8-aeb2-a8f66ad9553e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Flavor pref 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 11:41:53.472488 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-4c3a9cb9-ba34-4fc8-aeb2-a8f66ad9553e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Image pref 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 11:41:53.473154 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-4c3a9cb9-ba34-4fc8-aeb2-a8f66ad9553e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 11:41:53.493612 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4c3a9cb9-ba34-4fc8-aeb2-a8f66ad9553e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:53.494889 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4c3a9cb9-ba34-4fc8-aeb2-a8f66ad9553e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:53.495472 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4c3a9cb9-ba34-4fc8-aeb2-a8f66ad9553e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:53.496436 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4c3a9cb9-ba34-4fc8-aeb2-a8f66ad9553e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:53.496701 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-f5254175-ac73-4bbe-a140-d04315942dca tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f286fcc4b509485dbb958873a2207592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb846ed3b9141c694927b06b387b433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:53.496994 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4c3a9cb9-ba34-4fc8-aeb2-a8f66ad9553e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:53.501087 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4c3a9cb9-ba34-4fc8-aeb2-a8f66ad9553e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:53.509358 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-f5254175-ac73-4bbe-a140-d04315942dca tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] 10.222.0.17 "GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3" status: 200 len: 1463 microversion: 2.1 time: 0.245970 Oct 18 11:41:53.521545 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 99/208] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:53 2022] GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3 => generated 1463 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:53.521545 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-a90a3b61-e1b6-4c47-a050-f1c408b703b0 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:53.522011 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-a90a3b61-e1b6-4c47-a050-f1c408b703b0 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: ce665d5a-e059-4547-a267-a9a86d89a9c9] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:53.528772 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.quota [None req-4c3a9cb9-ba34-4fc8-aeb2-a8f66ad9553e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Getting quotas for project c84cfe68e5db4b2dba60443b48d23097. Resources: {'cores', 'instances', 'ram'} {{(pid=125485) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:41:53.535552 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:41:53.538717 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a90a3b61-e1b6-4c47-a050-f1c408b703b0 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:53.539164 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.quota [None req-4c3a9cb9-ba34-4fc8-aeb2-a8f66ad9553e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Getting quotas for user 72d748ebce2742058757304095d1a641 and project c84cfe68e5db4b2dba60443b48d23097. Resources: {'cores', 'instances', 'ram'} {{(pid=125485) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:41:53.541471 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a90a3b61-e1b6-4c47-a050-f1c408b703b0 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:53.542448 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a90a3b61-e1b6-4c47-a050-f1c408b703b0 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:53.545507 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a90a3b61-e1b6-4c47-a050-f1c408b703b0 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:53.546145 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a90a3b61-e1b6-4c47-a050-f1c408b703b0 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:53.546722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a90a3b61-e1b6-4c47-a050-f1c408b703b0 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:53.574971 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-4c3a9cb9-ba34-4fc8-aeb2-a8f66ad9553e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Going to run 1 instances... {{(pid=125485) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 11:41:53.586101 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-4c3a9cb9-ba34-4fc8-aeb2-a8f66ad9553e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4917b56-ebe0-409a-894a-469900c12b94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125485) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 11:41:53.597919 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a90a3b61-e1b6-4c47-a050-f1c408b703b0 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:53.598307 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a90a3b61-e1b6-4c47-a050-f1c408b703b0 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:53.598727 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a90a3b61-e1b6-4c47-a050-f1c408b703b0 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:53.599183 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.objects.instance [None req-a90a3b61-e1b6-4c47-a050-f1c408b703b0 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lazy-loading 'fault' on Instance uuid ce665d5a-e059-4547-a267-a9a86d89a9c9 {{(pid=125486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:41:53.659258 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-a90a3b61-e1b6-4c47-a050-f1c408b703b0 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:53.660194 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-4c3a9cb9-ba34-4fc8-aeb2-a8f66ad9553e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.007911 Oct 18 11:41:53.668952 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 110/209] 10.222.0.17 () {62 vars in 1188 bytes} [Tue Oct 18 11:41:52 2022] POST /compute/v2.1/servers => generated 400 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 11:41:53.673168 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-a90a3b61-e1b6-4c47-a050-f1c408b703b0 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9" status: 200 len: 1303 microversion: 2.1 time: 0.156530 Oct 18 11:41:53.674257 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 100/210] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:53 2022] GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9 => generated 1303 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:53.677406 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-9e2c16be-702c-4679-98a5-95841aff0e36 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:53.678154 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-9e2c16be-702c-4679-98a5-95841aff0e36 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] [instance: 0f243ecd-6943-4fe7-ab6d-5278787504e3] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:53.679411 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-a4673e18-e405-49ce-b5d7-bdc2628360d8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:53.680059 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-a4673e18-e405-49ce-b5d7-bdc2628360d8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:53.687591 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9e2c16be-702c-4679-98a5-95841aff0e36 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:53.688176 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9e2c16be-702c-4679-98a5-95841aff0e36 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:53.688831 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9e2c16be-702c-4679-98a5-95841aff0e36 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:53.690295 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9e2c16be-702c-4679-98a5-95841aff0e36 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:53.690959 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9e2c16be-702c-4679-98a5-95841aff0e36 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:53.691582 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9e2c16be-702c-4679-98a5-95841aff0e36 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:53.741621 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-9e2c16be-702c-4679-98a5-95841aff0e36 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] [instance: 0f243ecd-6943-4fe7-ab6d-5278787504e3] Going to try to terminate instance {{(pid=125485) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 11:41:53.746148 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-a4673e18-e405-49ce-b5d7-bdc2628360d8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:53.755897 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-a4673e18-e405-49ce-b5d7-bdc2628360d8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:53.757677 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-a4673e18-e405-49ce-b5d7-bdc2628360d8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:53.758962 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-a4673e18-e405-49ce-b5d7-bdc2628360d8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1282 microversion: 2.20 time: 0.083690 Oct 18 11:41:53.759628 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 101/211] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:41:53 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1282 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:41:53.851578 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-b4945185-6efc-4b05-bac4-8657c5fbd724 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:41:53.854942 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-b4945185-6efc-4b05-bac4-8657c5fbd724 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:53.867066 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b4945185-6efc-4b05-bac4-8657c5fbd724 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:53.867565 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b4945185-6efc-4b05-bac4-8657c5fbd724 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:53.868029 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b4945185-6efc-4b05-bac4-8657c5fbd724 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:53.872336 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b4945185-6efc-4b05-bac4-8657c5fbd724 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:53.873092 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b4945185-6efc-4b05-bac4-8657c5fbd724 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:53.873731 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b4945185-6efc-4b05-bac4-8657c5fbd724 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:53.892501 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-9e2c16be-702c-4679-98a5-95841aff0e36 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3" status: 204 len: 0 microversion: 2.1 time: 0.222013 Oct 18 11:41:53.893451 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 111/212] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Oct 18 11:41:53 2022] DELETE /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 11:41:53.904635 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-2f31ccc2-e000-443f-99e5-2242dae9ef40 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:53.905504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-2f31ccc2-e000-443f-99e5-2242dae9ef40 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] [instance: 0f243ecd-6943-4fe7-ab6d-5278787504e3] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:53.912110 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2f31ccc2-e000-443f-99e5-2242dae9ef40 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:53.912917 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2f31ccc2-e000-443f-99e5-2242dae9ef40 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:53.914024 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2f31ccc2-e000-443f-99e5-2242dae9ef40 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:53.915791 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2f31ccc2-e000-443f-99e5-2242dae9ef40 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:53.916463 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2f31ccc2-e000-443f-99e5-2242dae9ef40 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:53.917176 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2f31ccc2-e000-443f-99e5-2242dae9ef40 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:53.919527 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.objects.instance [None req-b4945185-6efc-4b05-bac4-8657c5fbd724 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lazy-loading 'flavor' on Instance uuid 774e4e5d-2e5c-40f1-943e-cb9bfd39738b {{(pid=125486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:41:54.055895 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-b4945185-6efc-4b05-bac4-8657c5fbd724 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "POST /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b/action" status: 200 len: 32 microversion: 2.1 time: 0.208278 Oct 18 11:41:54.056604 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 102/213] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Oct 18 11:41:53 2022] POST /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b/action => generated 32 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 11:41:54.066336 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-a7d3e6ec-c55d-4164-a666-8413aabb8450 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:54.067026 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-a7d3e6ec-c55d-4164-a666-8413aabb8450 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:54.073801 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a7d3e6ec-c55d-4164-a666-8413aabb8450 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:54.074294 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a7d3e6ec-c55d-4164-a666-8413aabb8450 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:54.074729 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a7d3e6ec-c55d-4164-a666-8413aabb8450 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:54.075654 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a7d3e6ec-c55d-4164-a666-8413aabb8450 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:54.076129 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a7d3e6ec-c55d-4164-a666-8413aabb8450 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:54.076616 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a7d3e6ec-c55d-4164-a666-8413aabb8450 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:54.099892 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-2f31ccc2-e000-443f-99e5-2242dae9ef40 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f286fcc4b509485dbb958873a2207592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb846ed3b9141c694927b06b387b433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:54.112181 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-2f31ccc2-e000-443f-99e5-2242dae9ef40 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] 10.222.0.17 "GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3" status: 200 len: 1469 microversion: 2.1 time: 0.214107 Oct 18 11:41:54.113104 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 112/214] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:53 2022] GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3 => generated 1469 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:41:54.235066 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-a7d3e6ec-c55d-4164-a666-8413aabb8450 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:54.246834 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-a7d3e6ec-c55d-4164-a666-8413aabb8450 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b" status: 200 len: 1522 microversion: 2.1 time: 0.184634 Oct 18 11:41:54.248103 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 103/215] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:54 2022] GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:54.695796 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-58337424-a189-4c60-8580-ef0e3f643293 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:54.697246 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-58337424-a189-4c60-8580-ef0e3f643293 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: ce665d5a-e059-4547-a267-a9a86d89a9c9] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:54.705776 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-58337424-a189-4c60-8580-ef0e3f643293 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:54.706517 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-58337424-a189-4c60-8580-ef0e3f643293 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:54.706943 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-58337424-a189-4c60-8580-ef0e3f643293 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:54.707789 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-58337424-a189-4c60-8580-ef0e3f643293 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:54.708553 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-58337424-a189-4c60-8580-ef0e3f643293 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:54.708998 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-58337424-a189-4c60-8580-ef0e3f643293 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:54.724780 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.wsgi [None req-58337424-a189-4c60-8580-ef0e3f643293 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] HTTP exception thrown: Instance ce665d5a-e059-4547-a267-a9a86d89a9c9 could not be found. Oct 18 11:41:54.727020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-58337424-a189-4c60-8580-ef0e3f643293 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Request method failure captured: Oct 18 11:41:54.727020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9 HTTP/1.1 Oct 18 11:41:54.727020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:41:54.727020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:41:54.727020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:41:54.727020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 0 Oct 18 11:41:54.727020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:41:54.727020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:41:54.727020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:41:54.727020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:41:54.727020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpDqrhHFpKshTi4gkx1Ll8gVpye5TgGTb9DyRh32beZWn8umOx5xIiHLyvWftaiE_tBalUpLn4PTrEWVCgApvieJkrMK_gxH_SmRBN4LGFDtrZO-UAIEk-ACi-uiuCTBYesmy1X2JlQxRkbazZmAur4fkAsa7dJXo8p0C4iFCjnwGiQ Oct 18 11:41:54.727020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:41:54.727020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:41:54.727020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:41:54.727020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:41:54.727020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:41:54.727020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:41:54.727020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: 047b4fe1eab744d9b871985c30e76b0d Oct 18 11:41:54.727020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-VolumesActionsTest-1399201092 Oct 18 11:41:54.727020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:41:54.727020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:41:54.728504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/047b4fe1eab744d9b871985c30e76b0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_047b4fe1eab744d9b871985c30e76b0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/047b4fe1eab744d9b871985c30e76b0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/047b4fe1eab744d9b871985c30e76b0d"}]}] Oct 18 11:41:54.728504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-VolumesActionsTest-1399201092 Oct 18 11:41:54.728504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: 047b4fe1eab744d9b871985c30e76b0d Oct 18 11:41:54.728504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-VolumesActionsTest-1399201092 Oct 18 11:41:54.728504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-VolumesActionsTest-1399201092-project Oct 18 11:41:54.728504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:41:54.728504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:41:54.728504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: fcb7dccab5ec46348c87ad4889120109 Oct 18 11:41:54.728504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-VolumesActionsTest-1399201092-project Oct 18 11:41:54.728504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: > Oct 18 11:41:54.728504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Instance ce665d5a-e059-4547-a267-a9a86d89a9c9 could not be found. Oct 18 11:41:54.728504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'id': 'ce665d5a-e059-4547-a267-a9a86d89a9c9'} Oct 18 11:41:54.729341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:41:54.729341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:41:54.729341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:41:54.729341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:41:54.729341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:41:54.729341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:41:54.729341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:41:54.729341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:41:54.729341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:41:54.729341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:41:54.729341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce665d5a-e059-4547-a267-a9a86d89a9c9 could not be found. Oct 18 11:41:54.729341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:41:54.729341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:41:54.729341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:41:54.729341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:41:54.729341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:41:54.729341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:41:54.729341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:41:54.729341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:41:54.729341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:41:54.730459 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:41:54.730459 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 11:41:54.730459 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 11:41:54.730459 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:41:54.730459 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:41:54.730459 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:41:54.730459 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:41:54.730459 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce665d5a-e059-4547-a267-a9a86d89a9c9 could not be found. Oct 18 11:41:54.730459 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:41:54.730459 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:41:54.730459 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:41:54.730459 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:41:54.730459 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:41:54.730459 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:41:54.730459 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:41:54.730459 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:41:54.730459 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce665d5a-e059-4547-a267-a9a86d89a9c9 could not be found. Oct 18 11:41:54.730459 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:41:54.731424 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-58337424-a189-4c60-8580-ef0e3f643293 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Returning 404 to user: Instance ce665d5a-e059-4547-a267-a9a86d89a9c9 could not be found. {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:41:54.731424 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-58337424-a189-4c60-8580-ef0e3f643293 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9" status: 404 len: 111 microversion: 2.1 time: 0.036563 Oct 18 11:41:54.731424 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 113/216] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:54 2022] GET /compute/v2.1/servers/ce665d5a-e059-4547-a267-a9a86d89a9c9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:41:54.786707 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-1203f10a-17ea-4463-9337-91e7ab38a195 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:54.787410 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-1203f10a-17ea-4463-9337-91e7ab38a195 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:54.794905 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1203f10a-17ea-4463-9337-91e7ab38a195 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:54.795742 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1203f10a-17ea-4463-9337-91e7ab38a195 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:54.796288 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1203f10a-17ea-4463-9337-91e7ab38a195 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:54.797036 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1203f10a-17ea-4463-9337-91e7ab38a195 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:54.797673 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1203f10a-17ea-4463-9337-91e7ab38a195 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:54.798149 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1203f10a-17ea-4463-9337-91e7ab38a195 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:54.843089 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-5a915957-aaf1-4a59-a4b6-6e2fe6464a9a tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-622057904", "imageRef": "a4917b56-ebe0-409a-894a-469900c12b94", "flavorRef": "452", "networks": [{"uuid": "b6b3633c-9a87-4a96-bcb5-0fed8272fb2d"}]}} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:41:54.874360 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-1203f10a-17ea-4463-9337-91e7ab38a195 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:54.886398 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-1203f10a-17ea-4463-9337-91e7ab38a195 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:54.892732 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-1203f10a-17ea-4463-9337-91e7ab38a195 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:54.894378 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-1203f10a-17ea-4463-9337-91e7ab38a195 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1286 microversion: 2.20 time: 0.111861 Oct 18 11:41:54.897256 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 104/217] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:41:54 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1286 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:41:54.922207 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.network.neutron [None req-5a915957-aaf1-4a59-a4b6-6e2fe6464a9a tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] validate_networks() for [('b6b3633c-9a87-4a96-bcb5-0fed8272fb2d', None, None, None, None, None)] {{(pid=125485) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 11:41:55.138196 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-e74a3c17-2343-49df-a603-508f88afd0c1 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:55.139561 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-e74a3c17-2343-49df-a603-508f88afd0c1 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] [instance: 0f243ecd-6943-4fe7-ab6d-5278787504e3] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:55.152051 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e74a3c17-2343-49df-a603-508f88afd0c1 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:55.154161 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e74a3c17-2343-49df-a603-508f88afd0c1 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:55.155139 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e74a3c17-2343-49df-a603-508f88afd0c1 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:55.156107 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e74a3c17-2343-49df-a603-508f88afd0c1 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:55.156768 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e74a3c17-2343-49df-a603-508f88afd0c1 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:55.158079 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e74a3c17-2343-49df-a603-508f88afd0c1 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:55.421856 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-5a915957-aaf1-4a59-a4b6-6e2fe6464a9a tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Flavor limits 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 11:41:55.422842 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-5a915957-aaf1-4a59-a4b6-6e2fe6464a9a tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Image limits 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 11:41:55.423518 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-5a915957-aaf1-4a59-a4b6-6e2fe6464a9a tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Flavor pref 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 11:41:55.424163 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-5a915957-aaf1-4a59-a4b6-6e2fe6464a9a tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Image pref 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 11:41:55.424728 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-5a915957-aaf1-4a59-a4b6-6e2fe6464a9a tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 11:41:55.435051 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5a915957-aaf1-4a59-a4b6-6e2fe6464a9a tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:55.435734 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5a915957-aaf1-4a59-a4b6-6e2fe6464a9a tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:55.436171 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5a915957-aaf1-4a59-a4b6-6e2fe6464a9a tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:55.436911 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5a915957-aaf1-4a59-a4b6-6e2fe6464a9a tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:55.437537 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5a915957-aaf1-4a59-a4b6-6e2fe6464a9a tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:55.438099 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5a915957-aaf1-4a59-a4b6-6e2fe6464a9a tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:55.464595 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.quota [None req-5a915957-aaf1-4a59-a4b6-6e2fe6464a9a tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Getting quotas for project 047b4fe1eab744d9b871985c30e76b0d. Resources: {'cores', 'instances', 'ram'} {{(pid=125485) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:41:55.471210 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.quota [None req-5a915957-aaf1-4a59-a4b6-6e2fe6464a9a tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Getting quotas for user fcb7dccab5ec46348c87ad4889120109 and project 047b4fe1eab744d9b871985c30e76b0d. Resources: {'cores', 'instances', 'ram'} {{(pid=125485) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:41:55.488777 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-5a915957-aaf1-4a59-a4b6-6e2fe6464a9a tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Going to run 1 instances... {{(pid=125485) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 11:41:55.491451 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-5a915957-aaf1-4a59-a4b6-6e2fe6464a9a tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: 6347f686-579a-4542-aa07-ec761fbc46f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4917b56-ebe0-409a-894a-469900c12b94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125485) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 11:41:55.545039 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-5a915957-aaf1-4a59-a4b6-6e2fe6464a9a tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.707999 Oct 18 11:41:55.545611 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 114/218] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Oct 18 11:41:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 11:41:55.551822 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-054a25b3-2720-4dbb-a13f-2edbceddaa5d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:55.552912 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-054a25b3-2720-4dbb-a13f-2edbceddaa5d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:55.560019 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-054a25b3-2720-4dbb-a13f-2edbceddaa5d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:55.560785 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-054a25b3-2720-4dbb-a13f-2edbceddaa5d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:55.561611 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-054a25b3-2720-4dbb-a13f-2edbceddaa5d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:55.562632 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-054a25b3-2720-4dbb-a13f-2edbceddaa5d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:55.563230 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-054a25b3-2720-4dbb-a13f-2edbceddaa5d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:55.575213 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-054a25b3-2720-4dbb-a13f-2edbceddaa5d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:55.755886 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-e74a3c17-2343-49df-a603-508f88afd0c1 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f286fcc4b509485dbb958873a2207592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb846ed3b9141c694927b06b387b433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:55.786555 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-e74a3c17-2343-49df-a603-508f88afd0c1 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] 10.222.0.17 "GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3" status: 200 len: 1469 microversion: 2.1 time: 0.654593 Oct 18 11:41:55.791079 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 105/219] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:55 2022] GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3 => generated 1469 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:41:55.798169 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-ea457d2a-a5e6-461f-abcb-e14b2a13baee tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:55.798778 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-ea457d2a-a5e6-461f-abcb-e14b2a13baee tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: 6347f686-579a-4542-aa07-ec761fbc46f8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:55.850706 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-054a25b3-2720-4dbb-a13f-2edbceddaa5d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:55.863457 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-054a25b3-2720-4dbb-a13f-2edbceddaa5d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b" status: 200 len: 1522 microversion: 2.1 time: 0.316197 Oct 18 11:41:55.879547 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 115/220] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:55 2022] GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:55.925643 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-ea457d2a-a5e6-461f-abcb-e14b2a13baee tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:55.928804 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-a8e00ad8-b045-46c0-ad7e-143ab335ed40 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:55.931076 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-a8e00ad8-b045-46c0-ad7e-143ab335ed40 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:55.939874 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-ea457d2a-a5e6-461f-abcb-e14b2a13baee tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8" status: 200 len: 1213 microversion: 2.1 time: 0.141696 Oct 18 11:41:55.940549 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 106/221] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:55 2022] GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8 => generated 1213 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:55.955184 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a8e00ad8-b045-46c0-ad7e-143ab335ed40 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:55.957108 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a8e00ad8-b045-46c0-ad7e-143ab335ed40 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:55.959423 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a8e00ad8-b045-46c0-ad7e-143ab335ed40 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:55.961734 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a8e00ad8-b045-46c0-ad7e-143ab335ed40 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:55.963214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a8e00ad8-b045-46c0-ad7e-143ab335ed40 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:55.964135 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a8e00ad8-b045-46c0-ad7e-143ab335ed40 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:56.055462 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-a8e00ad8-b045-46c0-ad7e-143ab335ed40 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:56.069478 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-a8e00ad8-b045-46c0-ad7e-143ab335ed40 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:56.071181 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-a8e00ad8-b045-46c0-ad7e-143ab335ed40 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:56.072799 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-a8e00ad8-b045-46c0-ad7e-143ab335ed40 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1334 microversion: 2.20 time: 0.154067 Oct 18 11:41:56.073924 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 116/222] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:41:55 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1334 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:41:56.459744 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-d6e26d56-2970-4ebf-967a-afc942b761bc req-8c03161f-c5f0-4f39-a48d-0f8e45832e7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f243ecd-6943-4fe7-ab6d-5278787504e3", "name": "network-vif-deleted", "tag": "15540fea-acab-4d31-91a0-3966b2b505f6"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:41:56.470336 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-d6e26d56-2970-4ebf-967a-afc942b761bc req-8c03161f-c5f0-4f39-a48d-0f8e45832e7b service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:56.471008 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-d6e26d56-2970-4ebf-967a-afc942b761bc req-8c03161f-c5f0-4f39-a48d-0f8e45832e7b service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:56.471501 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-d6e26d56-2970-4ebf-967a-afc942b761bc req-8c03161f-c5f0-4f39-a48d-0f8e45832e7b service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:56.485954 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-d6e26d56-2970-4ebf-967a-afc942b761bc req-8c03161f-c5f0-4f39-a48d-0f8e45832e7b service nova] Creating event network-vif-deleted:15540fea-acab-4d31-91a0-3966b2b505f6 for instance 0f243ecd-6943-4fe7-ab6d-5278787504e3 on hv-cinder-81558 Oct 18 11:41:56.491108 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-d6e26d56-2970-4ebf-967a-afc942b761bc req-8c03161f-c5f0-4f39-a48d-0f8e45832e7b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034821 Oct 18 11:41:56.493308 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 107/223] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:41:56.818260 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-2a9aae95-d1f2-4826-b4a8-6d50a2d5d680 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:56.820073 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-2a9aae95-d1f2-4826-b4a8-6d50a2d5d680 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] [instance: 0f243ecd-6943-4fe7-ab6d-5278787504e3] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:56.827311 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2a9aae95-d1f2-4826-b4a8-6d50a2d5d680 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:56.828244 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2a9aae95-d1f2-4826-b4a8-6d50a2d5d680 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:56.828883 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2a9aae95-d1f2-4826-b4a8-6d50a2d5d680 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:56.829868 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2a9aae95-d1f2-4826-b4a8-6d50a2d5d680 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:56.830404 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2a9aae95-d1f2-4826-b4a8-6d50a2d5d680 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:56.831011 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2a9aae95-d1f2-4826-b4a8-6d50a2d5d680 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:56.868572 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2a9aae95-d1f2-4826-b4a8-6d50a2d5d680 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:56.869254 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2a9aae95-d1f2-4826-b4a8-6d50a2d5d680 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:56.869730 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2a9aae95-d1f2-4826-b4a8-6d50a2d5d680 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:56.870295 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.objects.instance [None req-2a9aae95-d1f2-4826-b4a8-6d50a2d5d680 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lazy-loading 'fault' on Instance uuid 0f243ecd-6943-4fe7-ab6d-5278787504e3 {{(pid=125485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:41:56.889468 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-6881eee7-146c-461a-b148-1ce2ba0e88bd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:56.890180 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-6881eee7-146c-461a-b148-1ce2ba0e88bd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:56.901106 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6881eee7-146c-461a-b148-1ce2ba0e88bd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:56.901724 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6881eee7-146c-461a-b148-1ce2ba0e88bd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:56.902162 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6881eee7-146c-461a-b148-1ce2ba0e88bd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:56.903145 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6881eee7-146c-461a-b148-1ce2ba0e88bd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:56.904161 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6881eee7-146c-461a-b148-1ce2ba0e88bd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:56.904792 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6881eee7-146c-461a-b148-1ce2ba0e88bd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:56.939592 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-2a9aae95-d1f2-4826-b4a8-6d50a2d5d680 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f286fcc4b509485dbb958873a2207592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb846ed3b9141c694927b06b387b433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:56.948880 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-2a9aae95-d1f2-4826-b4a8-6d50a2d5d680 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] 10.222.0.17 "GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3" status: 200 len: 1303 microversion: 2.1 time: 0.136161 Oct 18 11:41:56.964159 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 117/224] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:56 2022] GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3 => generated 1303 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:56.964159 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-a27d7ace-8497-4319-99be-11e333d703bb tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:56.964159 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-a27d7ace-8497-4319-99be-11e333d703bb tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: 6347f686-579a-4542-aa07-ec761fbc46f8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:56.975041 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a27d7ace-8497-4319-99be-11e333d703bb tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:56.975041 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a27d7ace-8497-4319-99be-11e333d703bb tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:56.975907 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a27d7ace-8497-4319-99be-11e333d703bb tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:56.981343 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a27d7ace-8497-4319-99be-11e333d703bb tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:56.981343 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a27d7ace-8497-4319-99be-11e333d703bb tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:56.981343 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a27d7ace-8497-4319-99be-11e333d703bb tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:57.061032 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-a27d7ace-8497-4319-99be-11e333d703bb tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:57.069677 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-a27d7ace-8497-4319-99be-11e333d703bb tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8" status: 200 len: 1265 microversion: 2.1 time: 0.111109 Oct 18 11:41:57.070745 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 118/225] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:56 2022] GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8 => generated 1265 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:41:57.104306 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-1b5e9935-fdf8-4a4a-9c2d-5f1645bd455e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:57.104966 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-1b5e9935-fdf8-4a4a-9c2d-5f1645bd455e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:57.113190 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1b5e9935-fdf8-4a4a-9c2d-5f1645bd455e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:57.113982 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1b5e9935-fdf8-4a4a-9c2d-5f1645bd455e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:57.114569 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1b5e9935-fdf8-4a4a-9c2d-5f1645bd455e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:57.115440 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1b5e9935-fdf8-4a4a-9c2d-5f1645bd455e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:57.116223 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1b5e9935-fdf8-4a4a-9c2d-5f1645bd455e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:57.116795 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1b5e9935-fdf8-4a4a-9c2d-5f1645bd455e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:57.210477 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-1b5e9935-fdf8-4a4a-9c2d-5f1645bd455e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:57.212521 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-6881eee7-146c-461a-b148-1ce2ba0e88bd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:57.221339 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-6881eee7-146c-461a-b148-1ce2ba0e88bd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b" status: 200 len: 1522 microversion: 2.1 time: 0.337665 Oct 18 11:41:57.222486 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 108/226] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:56 2022] GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b => generated 1522 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:57.223669 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-1b5e9935-fdf8-4a4a-9c2d-5f1645bd455e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:57.225170 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-1b5e9935-fdf8-4a4a-9c2d-5f1645bd455e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:57.226277 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-1b5e9935-fdf8-4a4a-9c2d-5f1645bd455e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1340 microversion: 2.20 time: 0.127729 Oct 18 11:41:57.226820 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 119/227] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:41:57 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1340 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:41:57.980056 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-735972d0-81d2-4623-9f03-04dd18165b84 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:57.980752 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-735972d0-81d2-4623-9f03-04dd18165b84 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] [instance: 0f243ecd-6943-4fe7-ab6d-5278787504e3] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:57.988484 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-735972d0-81d2-4623-9f03-04dd18165b84 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:57.989018 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-735972d0-81d2-4623-9f03-04dd18165b84 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:57.989444 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-735972d0-81d2-4623-9f03-04dd18165b84 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:57.990132 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-735972d0-81d2-4623-9f03-04dd18165b84 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:57.990581 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-735972d0-81d2-4623-9f03-04dd18165b84 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:57.990996 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-735972d0-81d2-4623-9f03-04dd18165b84 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:58.028220 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-735972d0-81d2-4623-9f03-04dd18165b84 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:58.028652 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-735972d0-81d2-4623-9f03-04dd18165b84 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:58.029107 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-735972d0-81d2-4623-9f03-04dd18165b84 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:58.029902 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.objects.instance [None req-735972d0-81d2-4623-9f03-04dd18165b84 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lazy-loading 'fault' on Instance uuid 0f243ecd-6943-4fe7-ab6d-5278787504e3 {{(pid=125486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:41:58.034181 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:41:58.095733 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-53858f22-2ac6-4cc0-ad55-21b273b4ec35 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:58.097820 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-53858f22-2ac6-4cc0-ad55-21b273b4ec35 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: 6347f686-579a-4542-aa07-ec761fbc46f8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:58.105421 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-53858f22-2ac6-4cc0-ad55-21b273b4ec35 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:58.106118 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-53858f22-2ac6-4cc0-ad55-21b273b4ec35 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:58.107006 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-53858f22-2ac6-4cc0-ad55-21b273b4ec35 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:58.107741 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-53858f22-2ac6-4cc0-ad55-21b273b4ec35 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:58.108223 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-53858f22-2ac6-4cc0-ad55-21b273b4ec35 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:58.108989 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-53858f22-2ac6-4cc0-ad55-21b273b4ec35 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:58.122781 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-735972d0-81d2-4623-9f03-04dd18165b84 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f286fcc4b509485dbb958873a2207592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb846ed3b9141c694927b06b387b433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:58.154159 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-735972d0-81d2-4623-9f03-04dd18165b84 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] 10.222.0.17 "GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3" status: 200 len: 1303 microversion: 2.1 time: 0.179285 Oct 18 11:41:58.155568 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 109/228] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:57 2022] GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3 => generated 1303 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:58.206796 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-53858f22-2ac6-4cc0-ad55-21b273b4ec35 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:58.223159 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-53858f22-2ac6-4cc0-ad55-21b273b4ec35 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8" status: 200 len: 1271 microversion: 2.1 time: 0.130423 Oct 18 11:41:58.229638 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 120/229] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:58 2022] GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8 => generated 1271 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:41:58.247624 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-e66f5e14-db4a-4cf2-9187-402420f124dd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:58.248773 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-e66f5e14-db4a-4cf2-9187-402420f124dd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:58.257847 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e66f5e14-db4a-4cf2-9187-402420f124dd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:58.259234 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e66f5e14-db4a-4cf2-9187-402420f124dd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:58.260169 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e66f5e14-db4a-4cf2-9187-402420f124dd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:58.261675 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e66f5e14-db4a-4cf2-9187-402420f124dd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:58.262322 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e66f5e14-db4a-4cf2-9187-402420f124dd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:58.263346 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e66f5e14-db4a-4cf2-9187-402420f124dd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:58.274856 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-d77ad3dc-6a41-4c5b-9223-29f6e58d57d6 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:58.277274 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-d77ad3dc-6a41-4c5b-9223-29f6e58d57d6 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:58.288015 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d77ad3dc-6a41-4c5b-9223-29f6e58d57d6 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:58.289802 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d77ad3dc-6a41-4c5b-9223-29f6e58d57d6 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:58.290641 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d77ad3dc-6a41-4c5b-9223-29f6e58d57d6 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:58.293710 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d77ad3dc-6a41-4c5b-9223-29f6e58d57d6 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:58.294650 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d77ad3dc-6a41-4c5b-9223-29f6e58d57d6 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:58.295317 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d77ad3dc-6a41-4c5b-9223-29f6e58d57d6 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:58.495398 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-d77ad3dc-6a41-4c5b-9223-29f6e58d57d6 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:58.505260 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-d77ad3dc-6a41-4c5b-9223-29f6e58d57d6 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:58.508057 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-d77ad3dc-6a41-4c5b-9223-29f6e58d57d6 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:58.510709 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-d77ad3dc-6a41-4c5b-9223-29f6e58d57d6 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1406 microversion: 2.20 time: 0.263957 Oct 18 11:41:58.511789 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 121/230] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:41:58 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1406 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:41:58.609754 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-e66f5e14-db4a-4cf2-9187-402420f124dd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:58.620001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-e66f5e14-db4a-4cf2-9187-402420f124dd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b" status: 200 len: 1522 microversion: 2.1 time: 0.378727 Oct 18 11:41:58.620733 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 110/231] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:58 2022] GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:58.954094 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-2e8a7679-a662-4f11-a07f-82a63a6d96c1 req-31b4d416-4ff0-4ea9-b9e3-e300bcf09dcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2b9dfa2-7553-47cd-8274-6a0004bac79d", "tag": "03f3558a-e868-4501-8139-30b9edad14e0"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:41:58.964098 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-2e8a7679-a662-4f11-a07f-82a63a6d96c1 req-31b4d416-4ff0-4ea9-b9e3-e300bcf09dcb service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:58.964852 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-2e8a7679-a662-4f11-a07f-82a63a6d96c1 req-31b4d416-4ff0-4ea9-b9e3-e300bcf09dcb service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:58.965285 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-2e8a7679-a662-4f11-a07f-82a63a6d96c1 req-31b4d416-4ff0-4ea9-b9e3-e300bcf09dcb service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:59.121688 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-2e8a7679-a662-4f11-a07f-82a63a6d96c1 req-31b4d416-4ff0-4ea9-b9e3-e300bcf09dcb service nova] Creating event network-changed:03f3558a-e868-4501-8139-30b9edad14e0 for instance a2b9dfa2-7553-47cd-8274-6a0004bac79d on hv-cinder-81558 Oct 18 11:41:59.125590 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-2e8a7679-a662-4f11-a07f-82a63a6d96c1 req-31b4d416-4ff0-4ea9-b9e3-e300bcf09dcb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175013 Oct 18 11:41:59.126430 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 122/232] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:41:59.178908 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-6498e2cd-d8bd-4749-a6be-2e744138a9f7 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:59.179522 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-6498e2cd-d8bd-4749-a6be-2e744138a9f7 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] [instance: 0f243ecd-6943-4fe7-ab6d-5278787504e3] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:59.193641 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6498e2cd-d8bd-4749-a6be-2e744138a9f7 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:59.194162 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6498e2cd-d8bd-4749-a6be-2e744138a9f7 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:59.194597 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6498e2cd-d8bd-4749-a6be-2e744138a9f7 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:59.195678 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6498e2cd-d8bd-4749-a6be-2e744138a9f7 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:59.196150 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6498e2cd-d8bd-4749-a6be-2e744138a9f7 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:59.196569 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6498e2cd-d8bd-4749-a6be-2e744138a9f7 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:59.211893 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.wsgi [None req-6498e2cd-d8bd-4749-a6be-2e744138a9f7 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] HTTP exception thrown: Instance 0f243ecd-6943-4fe7-ab6d-5278787504e3 could not be found. Oct 18 11:41:59.213980 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-6498e2cd-d8bd-4749-a6be-2e744138a9f7 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Request method failure captured: Oct 18 11:41:59.213980 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: request: GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3 HTTP/1.1 Oct 18 11:41:59.213980 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept: application/json Oct 18 11:41:59.213980 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept-Encoding: identity Oct 18 11:41:59.213980 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Connection: close Oct 18 11:41:59.213980 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Length: 0 Oct 18 11:41:59.213980 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Type: application/json Oct 18 11:41:59.213980 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Host: 10.222.0.17 Oct 18 11:41:59.213980 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Openstack-System-Scope: None Oct 18 11:41:59.213980 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: User-Agent: python-urllib3/1.26.12 Oct 18 11:41:59.213980 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Auth-Token: gAAAAABjTpDvg-OIdTmBS93F6iSM3QtL_xDcbvkLf14Dpx8PUDiPsq5S0Ht6rf3R0BJx5CzUd_V58gNen-g2PzA0QlhmNVjQ9W3LI7-eO44VuqYz_7FVR0v0dtETo_SwPsyklGUPiZ-oIlmdgYuRSI_CEp3ywAvrjqc1ZfJH8aMpaTnEEUi9ZPg Oct 18 11:41:59.213980 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Id: None Oct 18 11:41:59.213980 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Name: None Oct 18 11:41:59.213980 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Identity-Status: Confirmed Oct 18 11:41:59.213980 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Is-Admin-Project: True Oct 18 11:41:59.213980 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Id: default Oct 18 11:41:59.213980 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Name: Default Oct 18 11:41:59.213980 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Id: 4fb846ed3b9141c694927b06b387b433 Oct 18 11:41:59.213980 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Name: tempest-VolumesNegativeTest-1598886654 Oct 18 11:41:59.213980 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Role: reader,member Oct 18 11:41:59.213980 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Roles: reader,member Oct 18 11:41:59.215464 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4fb846ed3b9141c694927b06b387b433"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4fb846ed3b9141c694927b06b387b433"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4fb846ed3b9141c694927b06b387b433"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4fb846ed3b9141c694927b06b387b433"}]}] Oct 18 11:41:59.215464 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant: tempest-VolumesNegativeTest-1598886654 Oct 18 11:41:59.215464 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Id: 4fb846ed3b9141c694927b06b387b433 Oct 18 11:41:59.215464 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Name: tempest-VolumesNegativeTest-1598886654 Oct 18 11:41:59.215464 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User: tempest-VolumesNegativeTest-1598886654-project Oct 18 11:41:59.215464 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Id: default Oct 18 11:41:59.215464 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Name: Default Oct 18 11:41:59.215464 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Id: f286fcc4b509485dbb958873a2207592 Oct 18 11:41:59.215464 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Name: tempest-VolumesNegativeTest-1598886654-project Oct 18 11:41:59.215464 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: method: > Oct 18 11:41:59.215464 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: exception: Instance 0f243ecd-6943-4fe7-ab6d-5278787504e3 could not be found. Oct 18 11:41:59.215464 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: action_args: {'id': '0f243ecd-6943-4fe7-ab6d-5278787504e3'} Oct 18 11:41:59.216177 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:41:59.216177 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:41:59.216177 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:41:59.216177 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:41:59.216177 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:41:59.216177 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:41:59.216177 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:41:59.216177 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:41:59.216177 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:41:59.216177 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:41:59.216177 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f243ecd-6943-4fe7-ab6d-5278787504e3 could not be found. Oct 18 11:41:59.216177 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:41:59.216177 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:41:59.216177 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:41:59.216177 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:41:59.216177 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:41:59.216177 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:41:59.216177 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:41:59.216177 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:41:59.216177 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:41:59.217337 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:41:59.217337 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 11:41:59.217337 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 11:41:59.217337 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:41:59.217337 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:41:59.217337 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:41:59.217337 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:41:59.217337 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f243ecd-6943-4fe7-ab6d-5278787504e3 could not be found. Oct 18 11:41:59.217337 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:41:59.217337 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:41:59.217337 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:41:59.217337 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:41:59.217337 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:41:59.217337 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:41:59.217337 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:41:59.217337 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:41:59.217337 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f243ecd-6943-4fe7-ab6d-5278787504e3 could not be found. Oct 18 11:41:59.217337 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:41:59.218350 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-6498e2cd-d8bd-4749-a6be-2e744138a9f7 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] Returning 404 to user: Instance 0f243ecd-6943-4fe7-ab6d-5278787504e3 could not be found. {{(pid=125486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:41:59.218350 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-6498e2cd-d8bd-4749-a6be-2e744138a9f7 tempest-VolumesNegativeTest-1598886654 tempest-VolumesNegativeTest-1598886654-project] 10.222.0.17 "GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3" status: 404 len: 111 microversion: 2.1 time: 0.040957 Oct 18 11:41:59.218350 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 111/233] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:59 2022] GET /compute/v2.1/servers/0f243ecd-6943-4fe7-ab6d-5278787504e3 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:41:59.249862 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-9859796b-0e8f-4823-bf46-e8488a68b175 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:59.250919 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-9859796b-0e8f-4823-bf46-e8488a68b175 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: 6347f686-579a-4542-aa07-ec761fbc46f8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:59.258480 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9859796b-0e8f-4823-bf46-e8488a68b175 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:59.259007 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9859796b-0e8f-4823-bf46-e8488a68b175 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:59.262960 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9859796b-0e8f-4823-bf46-e8488a68b175 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:59.262960 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9859796b-0e8f-4823-bf46-e8488a68b175 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:59.262960 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9859796b-0e8f-4823-bf46-e8488a68b175 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:59.262960 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9859796b-0e8f-4823-bf46-e8488a68b175 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:59.395420 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-a9f312b5-f188-47b0-ad34-3f3570b1ea58 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:59.395913 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-a9f312b5-f188-47b0-ad34-3f3570b1ea58 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:59.402562 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a9f312b5-f188-47b0-ad34-3f3570b1ea58 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:59.403270 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a9f312b5-f188-47b0-ad34-3f3570b1ea58 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:59.403856 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a9f312b5-f188-47b0-ad34-3f3570b1ea58 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:59.404709 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a9f312b5-f188-47b0-ad34-3f3570b1ea58 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:59.405373 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a9f312b5-f188-47b0-ad34-3f3570b1ea58 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:59.405963 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a9f312b5-f188-47b0-ad34-3f3570b1ea58 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:59.415144 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-9859796b-0e8f-4823-bf46-e8488a68b175 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:59.427154 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-9859796b-0e8f-4823-bf46-e8488a68b175 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8" status: 200 len: 1313 microversion: 2.1 time: 0.181420 Oct 18 11:41:59.435730 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 123/234] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:59 2022] GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:41:59.435924 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-a9f312b5-f188-47b0-ad34-3f3570b1ea58 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781/ips" status: 200 len: 146 microversion: 2.1 time: 0.039452 Oct 18 11:41:59.435924 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 112/235] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Oct 18 11:41:59 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:41:59.537640 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-435621a1-e86e-46fe-909f-da1505b98628 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:59.538259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-435621a1-e86e-46fe-909f-da1505b98628 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:59.544921 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-435621a1-e86e-46fe-909f-da1505b98628 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:59.546050 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-435621a1-e86e-46fe-909f-da1505b98628 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:59.546762 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-435621a1-e86e-46fe-909f-da1505b98628 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:59.547652 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-435621a1-e86e-46fe-909f-da1505b98628 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:59.548238 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-435621a1-e86e-46fe-909f-da1505b98628 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:59.548944 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-435621a1-e86e-46fe-909f-da1505b98628 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:59.571727 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:41:59.644123 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-c8f6e72b-b5a6-4bf6-9eff-b7a1aab041fb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:41:59.645085 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-c8f6e72b-b5a6-4bf6-9eff-b7a1aab041fb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:41:59.655128 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c8f6e72b-b5a6-4bf6-9eff-b7a1aab041fb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:59.655619 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c8f6e72b-b5a6-4bf6-9eff-b7a1aab041fb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:59.656050 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c8f6e72b-b5a6-4bf6-9eff-b7a1aab041fb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:59.656752 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c8f6e72b-b5a6-4bf6-9eff-b7a1aab041fb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:41:59.657244 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c8f6e72b-b5a6-4bf6-9eff-b7a1aab041fb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:41:59.657651 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c8f6e72b-b5a6-4bf6-9eff-b7a1aab041fb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:41:59.715915 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-435621a1-e86e-46fe-909f-da1505b98628 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:59.726675 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-435621a1-e86e-46fe-909f-da1505b98628 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:59.728282 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-435621a1-e86e-46fe-909f-da1505b98628 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:41:59.729476 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-435621a1-e86e-46fe-909f-da1505b98628 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1406 microversion: 2.20 time: 0.197774 Oct 18 11:41:59.730038 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 124/236] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:41:59 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:42:00.010314 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-c8f6e72b-b5a6-4bf6-9eff-b7a1aab041fb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:00.018018 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-c8f6e72b-b5a6-4bf6-9eff-b7a1aab041fb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b" status: 200 len: 1522 microversion: 2.1 time: 0.377921 Oct 18 11:42:00.034072 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 113/237] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:41:59 2022] GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b => generated 1522 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:00.452546 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-96e9c7ee-5f72-4bd8-a50b-b82570cbf560 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:00.453217 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-96e9c7ee-5f72-4bd8-a50b-b82570cbf560 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: 6347f686-579a-4542-aa07-ec761fbc46f8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:00.460878 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-96e9c7ee-5f72-4bd8-a50b-b82570cbf560 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:00.461954 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-96e9c7ee-5f72-4bd8-a50b-b82570cbf560 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:00.462411 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-96e9c7ee-5f72-4bd8-a50b-b82570cbf560 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:00.463661 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-96e9c7ee-5f72-4bd8-a50b-b82570cbf560 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:00.464461 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-96e9c7ee-5f72-4bd8-a50b-b82570cbf560 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:00.464934 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-96e9c7ee-5f72-4bd8-a50b-b82570cbf560 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:00.614275 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-96e9c7ee-5f72-4bd8-a50b-b82570cbf560 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:00.622521 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-96e9c7ee-5f72-4bd8-a50b-b82570cbf560 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8" status: 200 len: 1313 microversion: 2.1 time: 0.174948 Oct 18 11:42:00.623277 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 125/238] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:00 2022] GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:00.754151 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-511a39b0-51d1-4d42-be2d-7d9ca0610a79 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:00.754761 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-511a39b0-51d1-4d42-be2d-7d9ca0610a79 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:00.761787 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-511a39b0-51d1-4d42-be2d-7d9ca0610a79 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:00.762271 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-511a39b0-51d1-4d42-be2d-7d9ca0610a79 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:00.762870 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-511a39b0-51d1-4d42-be2d-7d9ca0610a79 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:00.768812 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-511a39b0-51d1-4d42-be2d-7d9ca0610a79 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:00.769468 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-511a39b0-51d1-4d42-be2d-7d9ca0610a79 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:00.770054 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-511a39b0-51d1-4d42-be2d-7d9ca0610a79 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:00.913662 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-511a39b0-51d1-4d42-be2d-7d9ca0610a79 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:00.924587 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-511a39b0-51d1-4d42-be2d-7d9ca0610a79 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:00.926355 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-511a39b0-51d1-4d42-be2d-7d9ca0610a79 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:00.927554 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-511a39b0-51d1-4d42-be2d-7d9ca0610a79 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1406 microversion: 2.20 time: 0.177492 Oct 18 11:42:00.928314 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 114/239] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:42:00 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:42:01.042580 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-e336b727-1480-4835-9a6d-0a12a984f62d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:01.043551 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-e336b727-1480-4835-9a6d-0a12a984f62d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:01.049498 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e336b727-1480-4835-9a6d-0a12a984f62d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:01.049983 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e336b727-1480-4835-9a6d-0a12a984f62d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:01.050418 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e336b727-1480-4835-9a6d-0a12a984f62d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:01.051110 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e336b727-1480-4835-9a6d-0a12a984f62d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:01.051571 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e336b727-1480-4835-9a6d-0a12a984f62d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:01.051987 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e336b727-1480-4835-9a6d-0a12a984f62d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:01.162592 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-6bdc4ac4-e07e-437c-b1d0-4149ed1ca1da req-0135f6bb-8ab6-44d2-8584-5c72c3bbec80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6347f686-579a-4542-aa07-ec761fbc46f8", "tag": "569e836a-1ab5-43ae-a604-b013afd5dcb6"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:42:01.187953 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-6bdc4ac4-e07e-437c-b1d0-4149ed1ca1da req-0135f6bb-8ab6-44d2-8584-5c72c3bbec80 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:01.188674 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-6bdc4ac4-e07e-437c-b1d0-4149ed1ca1da req-0135f6bb-8ab6-44d2-8584-5c72c3bbec80 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:01.189239 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-6bdc4ac4-e07e-437c-b1d0-4149ed1ca1da req-0135f6bb-8ab6-44d2-8584-5c72c3bbec80 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:01.202755 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-e336b727-1480-4835-9a6d-0a12a984f62d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:01.214577 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-6bdc4ac4-e07e-437c-b1d0-4149ed1ca1da req-0135f6bb-8ab6-44d2-8584-5c72c3bbec80 service nova] Creating event network-changed:569e836a-1ab5-43ae-a604-b013afd5dcb6 for instance 6347f686-579a-4542-aa07-ec761fbc46f8 on hv-cinder-81558 Oct 18 11:42:01.220095 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-e336b727-1480-4835-9a6d-0a12a984f62d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b" status: 200 len: 1522 microversion: 2.1 time: 0.181355 Oct 18 11:42:01.220821 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-6bdc4ac4-e07e-437c-b1d0-4149ed1ca1da req-0135f6bb-8ab6-44d2-8584-5c72c3bbec80 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065406 Oct 18 11:42:01.221678 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 115/240] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:42:01.230386 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 126/241] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:01 2022] GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:01.650828 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-d08248db-9fd1-47d1-9be2-96953ac08b3b tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:01.651538 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-d08248db-9fd1-47d1-9be2-96953ac08b3b tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: 6347f686-579a-4542-aa07-ec761fbc46f8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:01.659190 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d08248db-9fd1-47d1-9be2-96953ac08b3b tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:01.659767 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d08248db-9fd1-47d1-9be2-96953ac08b3b tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:01.660166 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d08248db-9fd1-47d1-9be2-96953ac08b3b tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:01.660883 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d08248db-9fd1-47d1-9be2-96953ac08b3b tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:01.661607 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d08248db-9fd1-47d1-9be2-96953ac08b3b tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:01.662241 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d08248db-9fd1-47d1-9be2-96953ac08b3b tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:01.954823 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-d851077f-b373-45e2-951f-fb8605d8b8dd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:01.955430 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-d851077f-b373-45e2-951f-fb8605d8b8dd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:01.962240 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d851077f-b373-45e2-951f-fb8605d8b8dd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:01.963078 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d851077f-b373-45e2-951f-fb8605d8b8dd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:01.963512 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d851077f-b373-45e2-951f-fb8605d8b8dd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:01.964475 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d851077f-b373-45e2-951f-fb8605d8b8dd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:01.964943 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d851077f-b373-45e2-951f-fb8605d8b8dd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:01.965122 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-d08248db-9fd1-47d1-9be2-96953ac08b3b tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:01.965587 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d851077f-b373-45e2-951f-fb8605d8b8dd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:01.974220 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-d08248db-9fd1-47d1-9be2-96953ac08b3b tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8" status: 200 len: 1313 microversion: 2.1 time: 0.332195 Oct 18 11:42:01.975013 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 116/242] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:01 2022] GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8 => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:02.132356 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-d851077f-b373-45e2-951f-fb8605d8b8dd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:02.142554 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-d851077f-b373-45e2-951f-fb8605d8b8dd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:02.143985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-d851077f-b373-45e2-951f-fb8605d8b8dd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:02.145403 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-d851077f-b373-45e2-951f-fb8605d8b8dd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1406 microversion: 2.20 time: 0.194832 Oct 18 11:42:02.162971 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 127/243] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:42:01 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:42:02.243907 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-f243858f-1aac-4356-b8f2-e54009f23bdb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:02.244787 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-f243858f-1aac-4356-b8f2-e54009f23bdb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:02.253771 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f243858f-1aac-4356-b8f2-e54009f23bdb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:02.254328 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f243858f-1aac-4356-b8f2-e54009f23bdb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:02.254762 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f243858f-1aac-4356-b8f2-e54009f23bdb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:02.255459 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f243858f-1aac-4356-b8f2-e54009f23bdb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:02.257179 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f243858f-1aac-4356-b8f2-e54009f23bdb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:02.258723 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f243858f-1aac-4356-b8f2-e54009f23bdb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:02.436445 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-f243858f-1aac-4356-b8f2-e54009f23bdb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:02.445530 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-f243858f-1aac-4356-b8f2-e54009f23bdb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b" status: 200 len: 1522 microversion: 2.1 time: 0.205799 Oct 18 11:42:02.446250 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 117/244] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:02 2022] GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:02.997066 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-3213407c-d39f-4089-831e-d1395b0e6093 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:02.997668 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-3213407c-d39f-4089-831e-d1395b0e6093 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: 6347f686-579a-4542-aa07-ec761fbc46f8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:03.004834 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3213407c-d39f-4089-831e-d1395b0e6093 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:03.005228 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3213407c-d39f-4089-831e-d1395b0e6093 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:03.005642 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3213407c-d39f-4089-831e-d1395b0e6093 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:03.006624 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3213407c-d39f-4089-831e-d1395b0e6093 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:03.007181 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3213407c-d39f-4089-831e-d1395b0e6093 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:03.007608 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3213407c-d39f-4089-831e-d1395b0e6093 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:03.185310 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-3fc142f8-ce42-4b09-b466-832941ae600f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:03.186498 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-3fc142f8-ce42-4b09-b466-832941ae600f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:03.191315 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-3213407c-d39f-4089-831e-d1395b0e6093 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:03.193531 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3fc142f8-ce42-4b09-b466-832941ae600f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:03.194247 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3fc142f8-ce42-4b09-b466-832941ae600f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:03.194911 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3fc142f8-ce42-4b09-b466-832941ae600f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:03.196245 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3fc142f8-ce42-4b09-b466-832941ae600f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:03.196821 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3fc142f8-ce42-4b09-b466-832941ae600f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:03.197368 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3fc142f8-ce42-4b09-b466-832941ae600f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:03.200421 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-3213407c-d39f-4089-831e-d1395b0e6093 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8" status: 200 len: 1313 microversion: 2.1 time: 0.207224 Oct 18 11:42:03.214390 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 128/245] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:02 2022] GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:03.468628 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-7d41309f-8039-4ef1-8575-85f1997e4fa2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:03.469342 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-7d41309f-8039-4ef1-8575-85f1997e4fa2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:03.474214 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-3fc142f8-ce42-4b09-b466-832941ae600f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:03.481777 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7d41309f-8039-4ef1-8575-85f1997e4fa2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:03.482285 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7d41309f-8039-4ef1-8575-85f1997e4fa2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:03.482709 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7d41309f-8039-4ef1-8575-85f1997e4fa2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:03.483417 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7d41309f-8039-4ef1-8575-85f1997e4fa2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:03.483869 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7d41309f-8039-4ef1-8575-85f1997e4fa2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:03.484290 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7d41309f-8039-4ef1-8575-85f1997e4fa2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:03.491836 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-3fc142f8-ce42-4b09-b466-832941ae600f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:03.498145 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-3fc142f8-ce42-4b09-b466-832941ae600f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:03.499514 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-3fc142f8-ce42-4b09-b466-832941ae600f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1406 microversion: 2.20 time: 0.327345 Oct 18 11:42:03.508995 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 118/246] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:42:03 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1406 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:42:03.705538 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-7d41309f-8039-4ef1-8575-85f1997e4fa2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:03.717715 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-7d41309f-8039-4ef1-8575-85f1997e4fa2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b" status: 200 len: 1522 microversion: 2.1 time: 0.251826 Oct 18 11:42:03.718460 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 129/247] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:03 2022] GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:03.866729 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-1b4a1185-8612-45ca-ac44-2e9755209fda req-f658e6ee-fb63-4d0d-a2f4-30960f5957b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2b9dfa2-7553-47cd-8274-6a0004bac79d", "name": "network-vif-plugged", "status": "completed", "tag": "03f3558a-e868-4501-8139-30b9edad14e0"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:42:03.883220 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-1b4a1185-8612-45ca-ac44-2e9755209fda req-f658e6ee-fb63-4d0d-a2f4-30960f5957b9 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:03.883725 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-1b4a1185-8612-45ca-ac44-2e9755209fda req-f658e6ee-fb63-4d0d-a2f4-30960f5957b9 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:03.884433 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-1b4a1185-8612-45ca-ac44-2e9755209fda req-f658e6ee-fb63-4d0d-a2f4-30960f5957b9 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:03.901410 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-1b4a1185-8612-45ca-ac44-2e9755209fda req-f658e6ee-fb63-4d0d-a2f4-30960f5957b9 service nova] Creating event network-vif-plugged:03f3558a-e868-4501-8139-30b9edad14e0 for instance a2b9dfa2-7553-47cd-8274-6a0004bac79d on hv-cinder-81558 Oct 18 11:42:03.907362 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-1b4a1185-8612-45ca-ac44-2e9755209fda req-f658e6ee-fb63-4d0d-a2f4-30960f5957b9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044547 Oct 18 11:42:03.908281 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 119/248] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:42:04.226051 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-a214f865-ea93-459d-94e2-66cc832ef898 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:04.227214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-a214f865-ea93-459d-94e2-66cc832ef898 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: 6347f686-579a-4542-aa07-ec761fbc46f8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:04.233627 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a214f865-ea93-459d-94e2-66cc832ef898 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:04.234118 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a214f865-ea93-459d-94e2-66cc832ef898 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:04.234555 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a214f865-ea93-459d-94e2-66cc832ef898 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:04.235278 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a214f865-ea93-459d-94e2-66cc832ef898 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:04.235829 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a214f865-ea93-459d-94e2-66cc832ef898 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:04.236358 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a214f865-ea93-459d-94e2-66cc832ef898 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:04.373313 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-a214f865-ea93-459d-94e2-66cc832ef898 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:04.384550 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-a214f865-ea93-459d-94e2-66cc832ef898 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8" status: 200 len: 1313 microversion: 2.1 time: 0.160917 Oct 18 11:42:04.385216 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 130/249] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:04 2022] GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:04.427671 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-5ef1c812-8388-47ef-b100-001c6b7ecb13 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cdb9065f-6ee5-463c-a205-20afa94a7220"}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:42:04.431844 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-5ef1c812-8388-47ef-b100-001c6b7ecb13 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:04.439373 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5ef1c812-8388-47ef-b100-001c6b7ecb13 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:04.440576 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5ef1c812-8388-47ef-b100-001c6b7ecb13 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:04.441091 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5ef1c812-8388-47ef-b100-001c6b7ecb13 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:04.441799 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5ef1c812-8388-47ef-b100-001c6b7ecb13 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:04.442253 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5ef1c812-8388-47ef-b100-001c6b7ecb13 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:04.442841 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5ef1c812-8388-47ef-b100-001c6b7ecb13 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:04.527890 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-9293c8b4-e94b-42a2-8c47-cdcea8372f46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:04.528748 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-9293c8b4-e94b-42a2-8c47-cdcea8372f46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:04.534645 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9293c8b4-e94b-42a2-8c47-cdcea8372f46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:04.535341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9293c8b4-e94b-42a2-8c47-cdcea8372f46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:04.535926 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9293c8b4-e94b-42a2-8c47-cdcea8372f46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:04.537079 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9293c8b4-e94b-42a2-8c47-cdcea8372f46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:04.537530 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9293c8b4-e94b-42a2-8c47-cdcea8372f46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:04.537955 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9293c8b4-e94b-42a2-8c47-cdcea8372f46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:04.704947 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-9293c8b4-e94b-42a2-8c47-cdcea8372f46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:04.714561 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-9293c8b4-e94b-42a2-8c47-cdcea8372f46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:04.715991 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-9293c8b4-e94b-42a2-8c47-cdcea8372f46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:04.717152 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-9293c8b4-e94b-42a2-8c47-cdcea8372f46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1406 microversion: 2.20 time: 0.194440 Oct 18 11:42:04.731569 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 131/250] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:42:04 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:42:04.741516 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-7ba5c2ea-0822-404d-bef8-cd098cff8934 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:04.743458 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-7ba5c2ea-0822-404d-bef8-cd098cff8934 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:04.750144 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7ba5c2ea-0822-404d-bef8-cd098cff8934 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:04.750597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7ba5c2ea-0822-404d-bef8-cd098cff8934 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:04.751025 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7ba5c2ea-0822-404d-bef8-cd098cff8934 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:04.751943 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7ba5c2ea-0822-404d-bef8-cd098cff8934 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:04.752550 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7ba5c2ea-0822-404d-bef8-cd098cff8934 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:04.753000 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7ba5c2ea-0822-404d-bef8-cd098cff8934 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:04.768634 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-5ef1c812-8388-47ef-b100-001c6b7ecb13 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "POST /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.346075 Oct 18 11:42:04.770761 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 120/251] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Oct 18 11:42:04 2022] POST /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781/os-volume_attachments => generated 194 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:42:04.894843 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-7ba5c2ea-0822-404d-bef8-cd098cff8934 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:04.903072 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-7ba5c2ea-0822-404d-bef8-cd098cff8934 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b" status: 200 len: 1522 microversion: 2.1 time: 0.165577 Oct 18 11:42:04.903772 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 132/252] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:04 2022] GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:05.408808 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-1eb5c6cd-d8d3-452a-8c90-70b60cf3c2e8 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:05.409862 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-1eb5c6cd-d8d3-452a-8c90-70b60cf3c2e8 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: 6347f686-579a-4542-aa07-ec761fbc46f8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:05.417089 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1eb5c6cd-d8d3-452a-8c90-70b60cf3c2e8 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:05.417880 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1eb5c6cd-d8d3-452a-8c90-70b60cf3c2e8 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:05.418545 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1eb5c6cd-d8d3-452a-8c90-70b60cf3c2e8 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:05.419523 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1eb5c6cd-d8d3-452a-8c90-70b60cf3c2e8 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:05.420057 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1eb5c6cd-d8d3-452a-8c90-70b60cf3c2e8 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:05.420677 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1eb5c6cd-d8d3-452a-8c90-70b60cf3c2e8 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:05.670299 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-1eb5c6cd-d8d3-452a-8c90-70b60cf3c2e8 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:05.681471 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-1eb5c6cd-d8d3-452a-8c90-70b60cf3c2e8 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8" status: 200 len: 1313 microversion: 2.1 time: 0.277513 Oct 18 11:42:05.682414 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 121/253] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:05 2022] GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8 => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:05.746875 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-6757bece-0a2f-423b-af8a-3130c439195d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:05.747468 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-6757bece-0a2f-423b-af8a-3130c439195d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:05.756703 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell0:SELECT=4 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:42:05.758622 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell0:SELECT=12 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:42:05.760383 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6757bece-0a2f-423b-af8a-3130c439195d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:05.761002 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6757bece-0a2f-423b-af8a-3130c439195d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:05.762466 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6757bece-0a2f-423b-af8a-3130c439195d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:05.763717 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6757bece-0a2f-423b-af8a-3130c439195d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:05.764690 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6757bece-0a2f-423b-af8a-3130c439195d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:05.765306 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6757bece-0a2f-423b-af8a-3130c439195d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:05.928423 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-e5a2592b-f36c-4a5f-9d7c-dd4b4bc38fd4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:05.929186 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-e5a2592b-f36c-4a5f-9d7c-dd4b4bc38fd4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:05.934708 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell0:SELECT=8 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:42:05.936647 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e5a2592b-f36c-4a5f-9d7c-dd4b4bc38fd4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:05.937343 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e5a2592b-f36c-4a5f-9d7c-dd4b4bc38fd4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:05.937776 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e5a2592b-f36c-4a5f-9d7c-dd4b4bc38fd4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:05.938488 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e5a2592b-f36c-4a5f-9d7c-dd4b4bc38fd4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:05.938937 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e5a2592b-f36c-4a5f-9d7c-dd4b4bc38fd4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:05.939540 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e5a2592b-f36c-4a5f-9d7c-dd4b4bc38fd4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:05.960558 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-6757bece-0a2f-423b-af8a-3130c439195d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:05.971421 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-6757bece-0a2f-423b-af8a-3130c439195d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:05.974345 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-6757bece-0a2f-423b-af8a-3130c439195d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:05.975803 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-6757bece-0a2f-423b-af8a-3130c439195d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1406 microversion: 2.20 time: 0.235372 Oct 18 11:42:05.978751 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 133/254] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:42:05 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:42:05.983541 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-30398bfa-eec7-4d55-a6fb-cabb4877a322 req-149c0ccb-90d9-401f-9f76-d036ed3dfcbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6347f686-579a-4542-aa07-ec761fbc46f8", "name": "network-vif-plugged", "status": "completed", "tag": "569e836a-1ab5-43ae-a604-b013afd5dcb6"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:42:05.993219 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-30398bfa-eec7-4d55-a6fb-cabb4877a322 req-149c0ccb-90d9-401f-9f76-d036ed3dfcbc service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:05.993903 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-30398bfa-eec7-4d55-a6fb-cabb4877a322 req-149c0ccb-90d9-401f-9f76-d036ed3dfcbc service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:05.994580 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-30398bfa-eec7-4d55-a6fb-cabb4877a322 req-149c0ccb-90d9-401f-9f76-d036ed3dfcbc service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:06.006159 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-30398bfa-eec7-4d55-a6fb-cabb4877a322 req-149c0ccb-90d9-401f-9f76-d036ed3dfcbc service nova] Creating event network-vif-plugged:569e836a-1ab5-43ae-a604-b013afd5dcb6 for instance 6347f686-579a-4542-aa07-ec761fbc46f8 on hv-cinder-81558 Oct 18 11:42:06.014372 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-30398bfa-eec7-4d55-a6fb-cabb4877a322 req-149c0ccb-90d9-401f-9f76-d036ed3dfcbc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034168 Oct 18 11:42:06.015499 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 134/255] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:42:06.153307 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-e5a2592b-f36c-4a5f-9d7c-dd4b4bc38fd4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:06.165487 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-e5a2592b-f36c-4a5f-9d7c-dd4b4bc38fd4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b" status: 200 len: 1522 microversion: 2.1 time: 0.242363 Oct 18 11:42:06.166597 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 122/256] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:05 2022] GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:42:06.705996 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-203f429d-9f2c-4376-bba5-511c781d4d4a tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:06.706914 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-203f429d-9f2c-4376-bba5-511c781d4d4a tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: 6347f686-579a-4542-aa07-ec761fbc46f8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:06.714985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-203f429d-9f2c-4376-bba5-511c781d4d4a tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:06.715843 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-203f429d-9f2c-4376-bba5-511c781d4d4a tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:06.716526 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-203f429d-9f2c-4376-bba5-511c781d4d4a tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:06.717507 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-203f429d-9f2c-4376-bba5-511c781d4d4a tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:06.718582 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-203f429d-9f2c-4376-bba5-511c781d4d4a tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:06.719181 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-203f429d-9f2c-4376-bba5-511c781d4d4a tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:06.919272 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-203f429d-9f2c-4376-bba5-511c781d4d4a tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:06.929807 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-203f429d-9f2c-4376-bba5-511c781d4d4a tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8" status: 200 len: 1313 microversion: 2.1 time: 0.228417 Oct 18 11:42:06.930416 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 135/257] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:06 2022] GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:07.004727 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-ff3d3872-1aa5-486f-a7c6-348c26876ff3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:07.006001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-ff3d3872-1aa5-486f-a7c6-348c26876ff3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:07.022975 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ff3d3872-1aa5-486f-a7c6-348c26876ff3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:07.023541 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ff3d3872-1aa5-486f-a7c6-348c26876ff3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:07.024046 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ff3d3872-1aa5-486f-a7c6-348c26876ff3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:07.024765 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ff3d3872-1aa5-486f-a7c6-348c26876ff3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:07.025579 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ff3d3872-1aa5-486f-a7c6-348c26876ff3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:07.026086 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ff3d3872-1aa5-486f-a7c6-348c26876ff3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:07.190812 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-1c47b33d-5e00-47b0-bd3c-70a9b9f75b12 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:07.191816 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-1c47b33d-5e00-47b0-bd3c-70a9b9f75b12 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:07.198364 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:42:07.203361 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1c47b33d-5e00-47b0-bd3c-70a9b9f75b12 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:07.204396 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1c47b33d-5e00-47b0-bd3c-70a9b9f75b12 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:07.205944 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1c47b33d-5e00-47b0-bd3c-70a9b9f75b12 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:07.206884 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1c47b33d-5e00-47b0-bd3c-70a9b9f75b12 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:07.207468 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1c47b33d-5e00-47b0-bd3c-70a9b9f75b12 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:07.207998 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1c47b33d-5e00-47b0-bd3c-70a9b9f75b12 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:07.351076 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-ff3d3872-1aa5-486f-a7c6-348c26876ff3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:07.360648 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-ff3d3872-1aa5-486f-a7c6-348c26876ff3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:07.362932 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-ff3d3872-1aa5-486f-a7c6-348c26876ff3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:07.364334 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-ff3d3872-1aa5-486f-a7c6-348c26876ff3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1598 microversion: 2.20 time: 0.364665 Oct 18 11:42:07.364972 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 123/258] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:42:06 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1598 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:42:07.390114 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-789933bc-74a5-41a6-a733-aedd87f38acd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:07.391181 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-1c47b33d-5e00-47b0-bd3c-70a9b9f75b12 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:07.391971 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-789933bc-74a5-41a6-a733-aedd87f38acd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:07.401073 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-789933bc-74a5-41a6-a733-aedd87f38acd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:07.401779 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-789933bc-74a5-41a6-a733-aedd87f38acd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:07.402888 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-789933bc-74a5-41a6-a733-aedd87f38acd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:07.403803 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-789933bc-74a5-41a6-a733-aedd87f38acd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:07.405128 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-789933bc-74a5-41a6-a733-aedd87f38acd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:07.405720 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-789933bc-74a5-41a6-a733-aedd87f38acd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:07.410839 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-1c47b33d-5e00-47b0-bd3c-70a9b9f75b12 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b" status: 200 len: 1522 microversion: 2.1 time: 0.224139 Oct 18 11:42:07.412117 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 136/259] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:07 2022] GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:07.553363 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-789933bc-74a5-41a6-a733-aedd87f38acd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.168183 Oct 18 11:42:07.553963 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 124/260] 10.222.0.17 () {60 vars in 1316 bytes} [Tue Oct 18 11:42:07 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d/os-interface => generated 284 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 11:42:07.954405 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-89a304fa-a53b-4141-8ec6-eba2091e029d tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:07.955652 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-89a304fa-a53b-4141-8ec6-eba2091e029d tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: 6347f686-579a-4542-aa07-ec761fbc46f8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:07.967897 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-89a304fa-a53b-4141-8ec6-eba2091e029d tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:07.969819 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-89a304fa-a53b-4141-8ec6-eba2091e029d tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:07.970490 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-89a304fa-a53b-4141-8ec6-eba2091e029d tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:07.971482 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-89a304fa-a53b-4141-8ec6-eba2091e029d tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:07.972144 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-89a304fa-a53b-4141-8ec6-eba2091e029d tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:07.972784 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-89a304fa-a53b-4141-8ec6-eba2091e029d tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:08.437861 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-5cb7e2de-e770-41e6-9fc4-82dc0b2f1862 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:08.438669 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-5cb7e2de-e770-41e6-9fc4-82dc0b2f1862 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:08.450156 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5cb7e2de-e770-41e6-9fc4-82dc0b2f1862 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:08.453174 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5cb7e2de-e770-41e6-9fc4-82dc0b2f1862 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:08.454399 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5cb7e2de-e770-41e6-9fc4-82dc0b2f1862 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:08.455363 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5cb7e2de-e770-41e6-9fc4-82dc0b2f1862 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:08.457394 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5cb7e2de-e770-41e6-9fc4-82dc0b2f1862 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:08.458563 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5cb7e2de-e770-41e6-9fc4-82dc0b2f1862 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:08.655500 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-89a304fa-a53b-4141-8ec6-eba2091e029d tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:08.673424 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-89a304fa-a53b-4141-8ec6-eba2091e029d tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8" status: 200 len: 1313 microversion: 2.1 time: 0.722842 Oct 18 11:42:08.675809 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 137/261] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:07 2022] GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8 => generated 1313 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:08.752962 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-5cb7e2de-e770-41e6-9fc4-82dc0b2f1862 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:08.763032 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-5cb7e2de-e770-41e6-9fc4-82dc0b2f1862 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b" status: 200 len: 1522 microversion: 2.1 time: 0.329819 Oct 18 11:42:08.774696 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 125/262] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:08 2022] GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:09.331636 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-56f051a3-bdd3-42a3-97df-5808c4f6454e req-be7cc979-1c7c-4d35-a08d-f73c38ef9169 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2b9dfa2-7553-47cd-8274-6a0004bac79d", "tag": "03f3558a-e868-4501-8139-30b9edad14e0"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:42:09.355673 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-56f051a3-bdd3-42a3-97df-5808c4f6454e req-be7cc979-1c7c-4d35-a08d-f73c38ef9169 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:09.356393 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-56f051a3-bdd3-42a3-97df-5808c4f6454e req-be7cc979-1c7c-4d35-a08d-f73c38ef9169 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:09.360201 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-56f051a3-bdd3-42a3-97df-5808c4f6454e req-be7cc979-1c7c-4d35-a08d-f73c38ef9169 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:09.392148 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-56f051a3-bdd3-42a3-97df-5808c4f6454e req-be7cc979-1c7c-4d35-a08d-f73c38ef9169 service nova] Creating event network-changed:03f3558a-e868-4501-8139-30b9edad14e0 for instance a2b9dfa2-7553-47cd-8274-6a0004bac79d on hv-cinder-81558 Oct 18 11:42:09.407028 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-56f051a3-bdd3-42a3-97df-5808c4f6454e req-be7cc979-1c7c-4d35-a08d-f73c38ef9169 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080223 Oct 18 11:42:09.421319 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 138/263] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:42:09.701045 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-8ec9df87-9caa-4c54-af39-7a74021f84bc tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:09.701847 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-8ec9df87-9caa-4c54-af39-7a74021f84bc tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: 6347f686-579a-4542-aa07-ec761fbc46f8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:09.714409 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8ec9df87-9caa-4c54-af39-7a74021f84bc tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:09.715007 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8ec9df87-9caa-4c54-af39-7a74021f84bc tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:09.715451 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8ec9df87-9caa-4c54-af39-7a74021f84bc tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:09.722173 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8ec9df87-9caa-4c54-af39-7a74021f84bc tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:09.722801 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8ec9df87-9caa-4c54-af39-7a74021f84bc tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:09.723252 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8ec9df87-9caa-4c54-af39-7a74021f84bc tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:09.788625 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-f27d199d-1c76-4a33-860e-70387b56ac25 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:09.789391 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-f27d199d-1c76-4a33-860e-70387b56ac25 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:09.798067 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f27d199d-1c76-4a33-860e-70387b56ac25 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:09.798565 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f27d199d-1c76-4a33-860e-70387b56ac25 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:09.805485 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f27d199d-1c76-4a33-860e-70387b56ac25 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:09.807859 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f27d199d-1c76-4a33-860e-70387b56ac25 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:09.810041 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f27d199d-1c76-4a33-860e-70387b56ac25 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:09.810613 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f27d199d-1c76-4a33-860e-70387b56ac25 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:10.083877 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-8ec9df87-9caa-4c54-af39-7a74021f84bc tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:10.099779 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-8ec9df87-9caa-4c54-af39-7a74021f84bc tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8" status: 200 len: 1497 microversion: 2.1 time: 0.405446 Oct 18 11:42:10.103429 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 126/264] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:09 2022] GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8 => generated 1497 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:10.118513 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-f27d199d-1c76-4a33-860e-70387b56ac25 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:10.129407 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-f27d199d-1c76-4a33-860e-70387b56ac25 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b" status: 200 len: 1522 microversion: 2.1 time: 0.344812 Oct 18 11:42:10.131550 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 139/265] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:09 2022] GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:10.837467 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-daccc211-0943-4f73-9ff2-d8473259f63d tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:10.838563 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-daccc211-0943-4f73-9ff2-d8473259f63d tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: 6347f686-579a-4542-aa07-ec761fbc46f8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:10.852195 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-daccc211-0943-4f73-9ff2-d8473259f63d tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:10.853009 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-daccc211-0943-4f73-9ff2-d8473259f63d tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:10.853766 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-daccc211-0943-4f73-9ff2-d8473259f63d tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:10.854468 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-daccc211-0943-4f73-9ff2-d8473259f63d tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:10.854917 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-daccc211-0943-4f73-9ff2-d8473259f63d tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:10.855350 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-daccc211-0943-4f73-9ff2-d8473259f63d tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:10.888207 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:42:10.909409 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-daccc211-0943-4f73-9ff2-d8473259f63d tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: 6347f686-579a-4542-aa07-ec761fbc46f8] Going to try to terminate instance {{(pid=125486) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 11:42:11.019673 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-daccc211-0943-4f73-9ff2-d8473259f63d tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8" status: 204 len: 0 microversion: 2.1 time: 0.189149 Oct 18 11:42:11.020420 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 127/266] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Oct 18 11:42:10 2022] DELETE /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 11:42:11.030233 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-2b581f24-0fa9-49b0-ad94-5ce6301a9ea2 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:11.030846 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-2b581f24-0fa9-49b0-ad94-5ce6301a9ea2 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: 6347f686-579a-4542-aa07-ec761fbc46f8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:11.037610 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2b581f24-0fa9-49b0-ad94-5ce6301a9ea2 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:11.038318 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2b581f24-0fa9-49b0-ad94-5ce6301a9ea2 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:11.039505 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2b581f24-0fa9-49b0-ad94-5ce6301a9ea2 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:11.040368 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2b581f24-0fa9-49b0-ad94-5ce6301a9ea2 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:11.041000 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2b581f24-0fa9-49b0-ad94-5ce6301a9ea2 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:11.041576 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2b581f24-0fa9-49b0-ad94-5ce6301a9ea2 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:11.159686 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-78865724-710e-4a95-a69f-d605716d8e8c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:11.160881 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-78865724-710e-4a95-a69f-d605716d8e8c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:11.193336 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-78865724-710e-4a95-a69f-d605716d8e8c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:11.193898 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-78865724-710e-4a95-a69f-d605716d8e8c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:11.194381 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-78865724-710e-4a95-a69f-d605716d8e8c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:11.196487 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-78865724-710e-4a95-a69f-d605716d8e8c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:11.198474 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-78865724-710e-4a95-a69f-d605716d8e8c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:11.199147 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-78865724-710e-4a95-a69f-d605716d8e8c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:11.251871 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-2b581f24-0fa9-49b0-ad94-5ce6301a9ea2 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:11.279810 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-2b581f24-0fa9-49b0-ad94-5ce6301a9ea2 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8" status: 200 len: 1503 microversion: 2.1 time: 0.250505 Oct 18 11:42:11.281735 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 140/267] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:11 2022] GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8 => generated 1503 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:11.511319 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-78865724-710e-4a95-a69f-d605716d8e8c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:11.538855 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-78865724-710e-4a95-a69f-d605716d8e8c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b" status: 200 len: 1502 microversion: 2.1 time: 0.379965 Oct 18 11:42:11.538855 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 128/268] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:11 2022] GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b => generated 1502 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:11.564191 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-cda57768-efbf-4b6d-b10e-631cdba23bde tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66c53a7f-ee74-48f5-9ef5-81ee1d38744b"}} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:42:11.575757 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-cda57768-efbf-4b6d-b10e-631cdba23bde tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:11.584225 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cda57768-efbf-4b6d-b10e-631cdba23bde tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:11.584713 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cda57768-efbf-4b6d-b10e-631cdba23bde tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:11.585176 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cda57768-efbf-4b6d-b10e-631cdba23bde tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:11.586448 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cda57768-efbf-4b6d-b10e-631cdba23bde tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:11.586933 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cda57768-efbf-4b6d-b10e-631cdba23bde tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:11.587435 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cda57768-efbf-4b6d-b10e-631cdba23bde tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:11.616999 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.wsgi [None req-cda57768-efbf-4b6d-b10e-631cdba23bde tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] HTTP exception thrown: Cannot 'attach_volume' instance 774e4e5d-2e5c-40f1-943e-cb9bfd39738b while it is in vm_state rescued Oct 18 11:42:11.619619 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-cda57768-efbf-4b6d-b10e-631cdba23bde tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Request method failure captured: Oct 18 11:42:11.619619 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: POST /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b/os-volume_attachments HTTP/1.1 Oct 18 11:42:11.619619 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:42:11.619619 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:42:11.619619 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:42:11.619619 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 74 Oct 18 11:42:11.619619 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:42:11.619619 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:42:11.619619 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:42:11.619619 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:42:11.619619 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpCyITCOuZ_3FbMTs3DhKEW_OwwcrGod2a_lrP_UNCZrETSVqjf-o7Z_Za1EvdYUbGePPsNMV1lYEK1fAp16Ng8WUSaI3Prsxzq9uX4zhASpgMp9MLYGWUxlDXz9kmC1mhrxhXDkhFi9KB2Jd7SlJFgu7FNGvZ6QYPd5pDBE_uJGE7M Oct 18 11:42:11.619619 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:42:11.619619 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:42:11.619619 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:42:11.619619 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:42:11.619619 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:42:11.619619 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:42:11.619619 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: cd52252f24114465af9bdf6e6fe68b76 Oct 18 11:42:11.619619 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1678509525 Oct 18 11:42:11.619619 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:42:11.619619 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:42:11.620866 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd52252f24114465af9bdf6e6fe68b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cd52252f24114465af9bdf6e6fe68b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cd52252f24114465af9bdf6e6fe68b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd52252f24114465af9bdf6e6fe68b76"}]}] Oct 18 11:42:11.620866 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1678509525 Oct 18 11:42:11.620866 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: cd52252f24114465af9bdf6e6fe68b76 Oct 18 11:42:11.620866 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1678509525 Oct 18 11:42:11.620866 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-ServerRescueNegativeTestJSON-1678509525-project Oct 18 11:42:11.620866 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:42:11.620866 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:42:11.620866 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: 1f624c36a3574b61bd17d5d73af71916 Oct 18 11:42:11.620866 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1678509525-project Oct 18 11:42:11.620866 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Oct 18 11:42:11.620866 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {"volumeAttachment": {"volumeId": "66c53a7f-ee74-48f5-9ef5-81ee1d38744b"}} Oct 18 11:42:11.620866 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: > Oct 18 11:42:11.621645 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Cannot 'attach_volume' instance 774e4e5d-2e5c-40f1-943e-cb9bfd39738b while it is in vm_state rescued Oct 18 11:42:11.621645 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'server_id': '774e4e5d-2e5c-40f1-943e-cb9bfd39738b', 'body': {'volumeAttachment': {'volumeId': '66c53a7f-ee74-48f5-9ef5-81ee1d38744b'}}} Oct 18 11:42:11.621645 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:42:11.621645 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:42:11.621645 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 18 11:42:11.621645 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 18 11:42:11.621645 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 11:42:11.621645 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 11:42:11.621645 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 11:42:11.621645 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 11:42:11.621645 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 774e4e5d-2e5c-40f1-943e-cb9bfd39738b in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 18 11:42:11.621645 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:42:11.621645 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:42:11.621645 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:42:11.621645 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:42:11.621645 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:42:11.621645 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:42:11.621645 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:42:11.621645 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:42:11.622642 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:42:11.622642 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:42:11.622642 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 11:42:11.622642 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 11:42:11.622642 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 11:42:11.622642 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 11:42:11.622642 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 11:42:11.622642 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 11:42:11.622642 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 18 11:42:11.622642 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 11:42:11.622642 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 11:42:11.622642 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 11:42:11.622642 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 774e4e5d-2e5c-40f1-943e-cb9bfd39738b while it is in vm_state rescued Oct 18 11:42:11.622642 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:42:11.622642 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:42:11.622642 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:42:11.622642 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:42:11.622642 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:42:11.622642 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:42:11.623703 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:42:11.623703 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:42:11.623703 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 774e4e5d-2e5c-40f1-943e-cb9bfd39738b while it is in vm_state rescued Oct 18 11:42:11.623703 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:42:11.623703 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-cda57768-efbf-4b6d-b10e-631cdba23bde tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Returning 409 to user: Cannot 'attach_volume' instance 774e4e5d-2e5c-40f1-943e-cb9bfd39738b while it is in vm_state rescued {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:42:11.623703 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-cda57768-efbf-4b6d-b10e-631cdba23bde tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "POST /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.062910 Oct 18 11:42:11.624046 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 141/269] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Oct 18 11:42:11 2022] POST /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b/os-volume_attachments => generated 152 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 11:42:11.634846 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-8e1d293b-6591-4af9-baa3-1b29c4c9c21c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:42:11.635460 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-8e1d293b-6591-4af9-baa3-1b29c4c9c21c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:11.644815 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8e1d293b-6591-4af9-baa3-1b29c4c9c21c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:11.645462 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8e1d293b-6591-4af9-baa3-1b29c4c9c21c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:11.645986 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8e1d293b-6591-4af9-baa3-1b29c4c9c21c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:11.646773 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8e1d293b-6591-4af9-baa3-1b29c4c9c21c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:11.647293 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8e1d293b-6591-4af9-baa3-1b29c4c9c21c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:11.648047 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8e1d293b-6591-4af9-baa3-1b29c4c9c21c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:11.737837 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-8e1d293b-6591-4af9-baa3-1b29c4c9c21c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "POST /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b/action" status: 202 len: 0 microversion: 2.1 time: 0.108675 Oct 18 11:42:11.738680 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 129/270] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Oct 18 11:42:11 2022] POST /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 11:42:11.747810 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-0cb73ce5-1bd9-4dff-8565-3751b53613c3 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:11.748322 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-0cb73ce5-1bd9-4dff-8565-3751b53613c3 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:11.757095 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0cb73ce5-1bd9-4dff-8565-3751b53613c3 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:11.758470 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0cb73ce5-1bd9-4dff-8565-3751b53613c3 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:11.759119 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0cb73ce5-1bd9-4dff-8565-3751b53613c3 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:11.760025 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0cb73ce5-1bd9-4dff-8565-3751b53613c3 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:11.760765 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0cb73ce5-1bd9-4dff-8565-3751b53613c3 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:11.761414 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0cb73ce5-1bd9-4dff-8565-3751b53613c3 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:11.927381 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-0cb73ce5-1bd9-4dff-8565-3751b53613c3 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:11.933910 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=100 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:42:11.940540 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-0cb73ce5-1bd9-4dff-8565-3751b53613c3 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b" status: 200 len: 1510 microversion: 2.1 time: 0.196664 Oct 18 11:42:11.941166 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 142/271] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:11 2022] GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b => generated 1510 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:12.307325 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-f2e35a81-8b35-465e-a33c-7a6affb8a066 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:12.308315 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-f2e35a81-8b35-465e-a33c-7a6affb8a066 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: 6347f686-579a-4542-aa07-ec761fbc46f8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:12.314869 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f2e35a81-8b35-465e-a33c-7a6affb8a066 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:12.315523 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f2e35a81-8b35-465e-a33c-7a6affb8a066 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:12.315976 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f2e35a81-8b35-465e-a33c-7a6affb8a066 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:12.316652 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f2e35a81-8b35-465e-a33c-7a6affb8a066 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:12.317161 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f2e35a81-8b35-465e-a33c-7a6affb8a066 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:12.317542 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f2e35a81-8b35-465e-a33c-7a6affb8a066 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:12.399756 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-fc3feb5a-bd8a-4a0c-bb65-a5f82e63047f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:12.400263 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-fc3feb5a-bd8a-4a0c-bb65-a5f82e63047f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:12.415285 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fc3feb5a-bd8a-4a0c-bb65-a5f82e63047f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:12.416415 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fc3feb5a-bd8a-4a0c-bb65-a5f82e63047f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:12.417229 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fc3feb5a-bd8a-4a0c-bb65-a5f82e63047f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:12.418118 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fc3feb5a-bd8a-4a0c-bb65-a5f82e63047f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:12.419426 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fc3feb5a-bd8a-4a0c-bb65-a5f82e63047f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:12.420002 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fc3feb5a-bd8a-4a0c-bb65-a5f82e63047f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:12.454507 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-fc3feb5a-bd8a-4a0c-bb65-a5f82e63047f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13/ips" status: 200 len: 148 microversion: 2.1 time: 0.066479 Oct 18 11:42:12.455595 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 143/272] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Oct 18 11:42:12 2022] GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13/ips => generated 148 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:42:12.610586 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-f2e35a81-8b35-465e-a33c-7a6affb8a066 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:12.622365 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-f2e35a81-8b35-465e-a33c-7a6affb8a066 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8" status: 200 len: 1503 microversion: 2.1 time: 0.320019 Oct 18 11:42:12.625714 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 130/273] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:12 2022] GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8 => generated 1503 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:42:12.964822 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-a00fb64b-b99c-4c94-be38-83e63bb6628b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:12.965494 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-a00fb64b-b99c-4c94-be38-83e63bb6628b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:12.974521 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a00fb64b-b99c-4c94-be38-83e63bb6628b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:12.975021 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a00fb64b-b99c-4c94-be38-83e63bb6628b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:12.975465 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a00fb64b-b99c-4c94-be38-83e63bb6628b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:12.976202 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a00fb64b-b99c-4c94-be38-83e63bb6628b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:12.981519 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a00fb64b-b99c-4c94-be38-83e63bb6628b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:12.982020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a00fb64b-b99c-4c94-be38-83e63bb6628b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:13.284194 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-a00fb64b-b99c-4c94-be38-83e63bb6628b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:13.296207 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-a00fb64b-b99c-4c94-be38-83e63bb6628b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b" status: 200 len: 1510 microversion: 2.1 time: 0.336312 Oct 18 11:42:13.315248 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 144/274] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:12 2022] GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b => generated 1510 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:13.650383 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-81da9701-062f-4153-afda-9e4f84c697b8 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:13.651225 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-81da9701-062f-4153-afda-9e4f84c697b8 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: 6347f686-579a-4542-aa07-ec761fbc46f8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:13.658188 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-81da9701-062f-4153-afda-9e4f84c697b8 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:13.659021 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-81da9701-062f-4153-afda-9e4f84c697b8 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:13.660035 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-81da9701-062f-4153-afda-9e4f84c697b8 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:13.661134 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-81da9701-062f-4153-afda-9e4f84c697b8 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:13.661836 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-81da9701-062f-4153-afda-9e4f84c697b8 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:13.662468 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-81da9701-062f-4153-afda-9e4f84c697b8 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:13.927835 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-771aa3e8-a88b-4a02-9b47-525963eede43 req-629bbab0-5f46-4830-80e6-2ee284da8d5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6347f686-579a-4542-aa07-ec761fbc46f8", "name": "network-vif-deleted", "tag": "569e836a-1ab5-43ae-a604-b013afd5dcb6"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:42:13.944173 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-771aa3e8-a88b-4a02-9b47-525963eede43 req-629bbab0-5f46-4830-80e6-2ee284da8d5b service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:13.944944 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-771aa3e8-a88b-4a02-9b47-525963eede43 req-629bbab0-5f46-4830-80e6-2ee284da8d5b service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:13.945750 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-771aa3e8-a88b-4a02-9b47-525963eede43 req-629bbab0-5f46-4830-80e6-2ee284da8d5b service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:13.962875 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-771aa3e8-a88b-4a02-9b47-525963eede43 req-629bbab0-5f46-4830-80e6-2ee284da8d5b service nova] Creating event network-vif-deleted:569e836a-1ab5-43ae-a604-b013afd5dcb6 for instance 6347f686-579a-4542-aa07-ec761fbc46f8 on hv-cinder-81558 Oct 18 11:42:13.969847 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-771aa3e8-a88b-4a02-9b47-525963eede43 req-629bbab0-5f46-4830-80e6-2ee284da8d5b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045555 Oct 18 11:42:13.974113 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 145/275] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:42:14.040122 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-bcf49f78-40ae-4878-8916-5b93682e6620 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0199a44-ae26-486c-8aca-e1c4de2117d6"}} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:42:14.043088 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-bcf49f78-40ae-4878-8916-5b93682e6620 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:14.051562 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bcf49f78-40ae-4878-8916-5b93682e6620 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:14.052159 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bcf49f78-40ae-4878-8916-5b93682e6620 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:14.052700 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bcf49f78-40ae-4878-8916-5b93682e6620 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:14.053534 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bcf49f78-40ae-4878-8916-5b93682e6620 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:14.054343 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bcf49f78-40ae-4878-8916-5b93682e6620 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:14.055222 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bcf49f78-40ae-4878-8916-5b93682e6620 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:14.198694 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-81da9701-062f-4153-afda-9e4f84c697b8 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:14.217186 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-81da9701-062f-4153-afda-9e4f84c697b8 tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8" status: 200 len: 1503 microversion: 2.1 time: 0.571025 Oct 18 11:42:14.218244 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 131/276] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:13 2022] GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8 => generated 1503 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:14.334341 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-58a1029e-bbcd-4b77-a137-bcc4708e4cba tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:14.335309 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-58a1029e-bbcd-4b77-a137-bcc4708e4cba tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:14.358848 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-58a1029e-bbcd-4b77-a137-bcc4708e4cba tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:14.359407 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-58a1029e-bbcd-4b77-a137-bcc4708e4cba tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:14.359858 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-58a1029e-bbcd-4b77-a137-bcc4708e4cba tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:14.362623 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-58a1029e-bbcd-4b77-a137-bcc4708e4cba tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:14.363116 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-58a1029e-bbcd-4b77-a137-bcc4708e4cba tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:14.363556 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-58a1029e-bbcd-4b77-a137-bcc4708e4cba tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:14.612461 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-bcf49f78-40ae-4878-8916-5b93682e6620 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "POST /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.578326 Oct 18 11:42:14.613901 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 146/277] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Oct 18 11:42:14 2022] POST /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13/os-volume_attachments => generated 194 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:42:14.725471 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-783c8f03-a977-411d-a126-1914c67a30aa tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:42:14.733233 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-783c8f03-a977-411d-a126-1914c67a30aa tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:14.733895 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-783c8f03-a977-411d-a126-1914c67a30aa tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:14.734490 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-783c8f03-a977-411d-a126-1914c67a30aa tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:14.862461 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-783c8f03-a977-411d-a126-1914c67a30aa tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Going to try to stop instance {{(pid=125485) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 11:42:14.979301 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-783c8f03-a977-411d-a126-1914c67a30aa tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "POST /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781/action" status: 202 len: 0 microversion: 2.1 time: 0.259845 Oct 18 11:42:14.983609 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 147/278] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Oct 18 11:42:14 2022] POST /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 11:42:15.004133 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-d4699947-1005-457e-a9c8-ba3fdaaeffe2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:15.005170 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-d4699947-1005-457e-a9c8-ba3fdaaeffe2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:15.021683 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d4699947-1005-457e-a9c8-ba3fdaaeffe2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:15.022314 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d4699947-1005-457e-a9c8-ba3fdaaeffe2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:15.022760 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d4699947-1005-457e-a9c8-ba3fdaaeffe2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:15.023512 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d4699947-1005-457e-a9c8-ba3fdaaeffe2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:15.023969 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d4699947-1005-457e-a9c8-ba3fdaaeffe2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:15.024395 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d4699947-1005-457e-a9c8-ba3fdaaeffe2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:15.153325 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-58a1029e-bbcd-4b77-a137-bcc4708e4cba tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:15.162646 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-58a1029e-bbcd-4b77-a137-bcc4708e4cba tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b" status: 200 len: 1510 microversion: 2.1 time: 0.840594 Oct 18 11:42:15.163237 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 132/279] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:14 2022] GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b => generated 1510 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:15.244570 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-055fd69c-2511-479e-93c3-842dbc67174b tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:15.251968 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-055fd69c-2511-479e-93c3-842dbc67174b tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: 6347f686-579a-4542-aa07-ec761fbc46f8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:15.268943 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-055fd69c-2511-479e-93c3-842dbc67174b tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:15.270116 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-055fd69c-2511-479e-93c3-842dbc67174b tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:15.272391 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-055fd69c-2511-479e-93c3-842dbc67174b tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:15.273714 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-055fd69c-2511-479e-93c3-842dbc67174b tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:15.275388 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-055fd69c-2511-479e-93c3-842dbc67174b tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:15.276302 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-055fd69c-2511-479e-93c3-842dbc67174b tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:15.303320 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-d4699947-1005-457e-a9c8-ba3fdaaeffe2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:15.318332 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-d4699947-1005-457e-a9c8-ba3fdaaeffe2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1722 microversion: 2.1 time: 0.333183 Oct 18 11:42:15.334003 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 148/280] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:14 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1722 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:15.347359 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-055fd69c-2511-479e-93c3-842dbc67174b tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:15.347853 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-055fd69c-2511-479e-93c3-842dbc67174b tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:15.348292 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-055fd69c-2511-479e-93c3-842dbc67174b tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:15.348747 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.objects.instance [None req-055fd69c-2511-479e-93c3-842dbc67174b tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lazy-loading 'fault' on Instance uuid 6347f686-579a-4542-aa07-ec761fbc46f8 {{(pid=125486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:42:15.434562 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-055fd69c-2511-479e-93c3-842dbc67174b tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb7dccab5ec46348c87ad4889120109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4fe1eab744d9b871985c30e76b0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:15.443864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-055fd69c-2511-479e-93c3-842dbc67174b tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8" status: 200 len: 1303 microversion: 2.1 time: 0.203843 Oct 18 11:42:15.465073 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 133/281] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:15 2022] GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8 => generated 1303 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:42:16.188372 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-1cd8d6cd-db4f-42b4-b301-6ea5bb5faf54 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:16.189747 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-1cd8d6cd-db4f-42b4-b301-6ea5bb5faf54 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:16.200983 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1cd8d6cd-db4f-42b4-b301-6ea5bb5faf54 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:16.201779 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1cd8d6cd-db4f-42b4-b301-6ea5bb5faf54 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:16.202220 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1cd8d6cd-db4f-42b4-b301-6ea5bb5faf54 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:16.202933 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1cd8d6cd-db4f-42b4-b301-6ea5bb5faf54 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:16.203390 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1cd8d6cd-db4f-42b4-b301-6ea5bb5faf54 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:16.203821 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1cd8d6cd-db4f-42b4-b301-6ea5bb5faf54 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:16.348399 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-dbcb0fb9-eb02-440e-9e0a-7a0510d75f79 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:16.349060 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-dbcb0fb9-eb02-440e-9e0a-7a0510d75f79 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:16.372430 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dbcb0fb9-eb02-440e-9e0a-7a0510d75f79 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:16.383002 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dbcb0fb9-eb02-440e-9e0a-7a0510d75f79 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:16.383599 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dbcb0fb9-eb02-440e-9e0a-7a0510d75f79 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:16.384352 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dbcb0fb9-eb02-440e-9e0a-7a0510d75f79 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:16.384829 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dbcb0fb9-eb02-440e-9e0a-7a0510d75f79 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:16.385278 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dbcb0fb9-eb02-440e-9e0a-7a0510d75f79 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:16.519595 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-1cd8d6cd-db4f-42b4-b301-6ea5bb5faf54 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:16.529282 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-1cd8d6cd-db4f-42b4-b301-6ea5bb5faf54 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b" status: 200 len: 1510 microversion: 2.1 time: 0.346582 Oct 18 11:42:16.546494 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 149/282] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:16 2022] GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b => generated 1510 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:16.554300 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-96e51f15-b7c9-4892-ba1e-8fd80ef1b57e tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:16.555139 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-96e51f15-b7c9-4892-ba1e-8fd80ef1b57e tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] [instance: 6347f686-579a-4542-aa07-ec761fbc46f8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:16.569061 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-96e51f15-b7c9-4892-ba1e-8fd80ef1b57e tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:16.569556 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-96e51f15-b7c9-4892-ba1e-8fd80ef1b57e tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:16.570167 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-96e51f15-b7c9-4892-ba1e-8fd80ef1b57e tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:16.573522 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-96e51f15-b7c9-4892-ba1e-8fd80ef1b57e tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:16.574050 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-96e51f15-b7c9-4892-ba1e-8fd80ef1b57e tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:16.574654 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-96e51f15-b7c9-4892-ba1e-8fd80ef1b57e tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:16.593928 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.wsgi [None req-96e51f15-b7c9-4892-ba1e-8fd80ef1b57e tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] HTTP exception thrown: Instance 6347f686-579a-4542-aa07-ec761fbc46f8 could not be found. Oct 18 11:42:16.595590 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-96e51f15-b7c9-4892-ba1e-8fd80ef1b57e tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Request method failure captured: Oct 18 11:42:16.595590 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8 HTTP/1.1 Oct 18 11:42:16.595590 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:42:16.595590 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:42:16.595590 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:42:16.595590 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 0 Oct 18 11:42:16.595590 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:42:16.595590 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:42:16.595590 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:42:16.595590 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:42:16.595590 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpDqrhHFpKshTi4gkx1Ll8gVpye5TgGTb9DyRh32beZWn8umOx5xIiHLyvWftaiE_tBalUpLn4PTrEWVCgApvieJkrMK_gxH_SmRBN4LGFDtrZO-UAIEk-ACi-uiuCTBYesmy1X2JlQxRkbazZmAur4fkAsa7dJXo8p0C4iFCjnwGiQ Oct 18 11:42:16.595590 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:42:16.595590 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:42:16.595590 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:42:16.595590 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:42:16.595590 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:42:16.595590 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:42:16.595590 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: 047b4fe1eab744d9b871985c30e76b0d Oct 18 11:42:16.595590 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-VolumesActionsTest-1399201092 Oct 18 11:42:16.595590 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:42:16.595590 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:42:16.597055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/047b4fe1eab744d9b871985c30e76b0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_047b4fe1eab744d9b871985c30e76b0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/047b4fe1eab744d9b871985c30e76b0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/047b4fe1eab744d9b871985c30e76b0d"}]}] Oct 18 11:42:16.597055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-VolumesActionsTest-1399201092 Oct 18 11:42:16.597055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: 047b4fe1eab744d9b871985c30e76b0d Oct 18 11:42:16.597055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-VolumesActionsTest-1399201092 Oct 18 11:42:16.597055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-VolumesActionsTest-1399201092-project Oct 18 11:42:16.597055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:42:16.597055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:42:16.597055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: fcb7dccab5ec46348c87ad4889120109 Oct 18 11:42:16.597055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-VolumesActionsTest-1399201092-project Oct 18 11:42:16.597055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: > Oct 18 11:42:16.597055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Instance 6347f686-579a-4542-aa07-ec761fbc46f8 could not be found. Oct 18 11:42:16.597055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'id': '6347f686-579a-4542-aa07-ec761fbc46f8'} Oct 18 11:42:16.597748 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:42:16.597748 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:42:16.597748 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:42:16.597748 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:42:16.597748 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:42:16.597748 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:42:16.597748 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:42:16.597748 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:42:16.597748 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:42:16.597748 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:42:16.597748 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6347f686-579a-4542-aa07-ec761fbc46f8 could not be found. Oct 18 11:42:16.597748 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:42:16.597748 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:42:16.597748 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:42:16.597748 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:42:16.597748 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:42:16.597748 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:42:16.597748 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:42:16.597748 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:42:16.597748 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:42:16.598913 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:42:16.598913 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 11:42:16.598913 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 11:42:16.598913 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:42:16.598913 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:42:16.598913 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:42:16.598913 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:42:16.598913 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6347f686-579a-4542-aa07-ec761fbc46f8 could not be found. Oct 18 11:42:16.598913 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:42:16.598913 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:42:16.598913 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:42:16.598913 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:42:16.598913 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:42:16.598913 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:42:16.598913 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:42:16.598913 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:42:16.598913 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6347f686-579a-4542-aa07-ec761fbc46f8 could not be found. Oct 18 11:42:16.598913 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:42:16.599874 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-96e51f15-b7c9-4892-ba1e-8fd80ef1b57e tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] Returning 404 to user: Instance 6347f686-579a-4542-aa07-ec761fbc46f8 could not be found. {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:42:16.599874 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-96e51f15-b7c9-4892-ba1e-8fd80ef1b57e tempest-VolumesActionsTest-1399201092 tempest-VolumesActionsTest-1399201092-project] 10.222.0.17 "GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8" status: 404 len: 111 microversion: 2.1 time: 0.049079 Oct 18 11:42:16.599874 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 150/283] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:16 2022] GET /compute/v2.1/servers/6347f686-579a-4542-aa07-ec761fbc46f8 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:42:16.732036 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-dbcb0fb9-eb02-440e-9e0a-7a0510d75f79 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:16.742227 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-dbcb0fb9-eb02-440e-9e0a-7a0510d75f79 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1722 microversion: 2.1 time: 0.400087 Oct 18 11:42:16.746737 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 134/284] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:16 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1722 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:17.562943 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-1e793fc6-4972-44a5-9c46-fec8f77f88f1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:17.564405 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-1e793fc6-4972-44a5-9c46-fec8f77f88f1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:17.577479 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1e793fc6-4972-44a5-9c46-fec8f77f88f1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:17.581166 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1e793fc6-4972-44a5-9c46-fec8f77f88f1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:17.581605 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1e793fc6-4972-44a5-9c46-fec8f77f88f1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:17.583867 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1e793fc6-4972-44a5-9c46-fec8f77f88f1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:17.584350 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1e793fc6-4972-44a5-9c46-fec8f77f88f1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:17.584794 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1e793fc6-4972-44a5-9c46-fec8f77f88f1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:17.777407 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-bbe8362e-e2cf-4a7e-ac73-f08436798663 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:17.778197 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-bbe8362e-e2cf-4a7e-ac73-f08436798663 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:17.793989 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-bbe8362e-e2cf-4a7e-ac73-f08436798663 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:17.794496 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-bbe8362e-e2cf-4a7e-ac73-f08436798663 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:17.795321 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-bbe8362e-e2cf-4a7e-ac73-f08436798663 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:17.797013 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-bbe8362e-e2cf-4a7e-ac73-f08436798663 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:17.799464 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-bbe8362e-e2cf-4a7e-ac73-f08436798663 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:17.801363 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-bbe8362e-e2cf-4a7e-ac73-f08436798663 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:17.849770 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-1e793fc6-4972-44a5-9c46-fec8f77f88f1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:17.859117 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-1e793fc6-4972-44a5-9c46-fec8f77f88f1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b" status: 200 len: 1516 microversion: 2.1 time: 0.305089 Oct 18 11:42:17.861169 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 151/285] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:17 2022] GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b => generated 1516 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:17.998949 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-bbe8362e-e2cf-4a7e-ac73-f08436798663 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:18.012077 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-bbe8362e-e2cf-4a7e-ac73-f08436798663 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1722 microversion: 2.1 time: 0.240396 Oct 18 11:42:18.029091 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 135/286] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:17 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:19.042488 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-8b927bf5-8fb6-473e-9b04-ec6bf296d30e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:19.043110 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-8b927bf5-8fb6-473e-9b04-ec6bf296d30e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:19.050885 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8b927bf5-8fb6-473e-9b04-ec6bf296d30e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:19.051422 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8b927bf5-8fb6-473e-9b04-ec6bf296d30e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:19.052032 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8b927bf5-8fb6-473e-9b04-ec6bf296d30e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:19.052949 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8b927bf5-8fb6-473e-9b04-ec6bf296d30e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:19.053766 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8b927bf5-8fb6-473e-9b04-ec6bf296d30e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:19.057260 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8b927bf5-8fb6-473e-9b04-ec6bf296d30e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:19.578538 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-8b927bf5-8fb6-473e-9b04-ec6bf296d30e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:19.594290 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-8b927bf5-8fb6-473e-9b04-ec6bf296d30e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1722 microversion: 2.1 time: 0.562372 Oct 18 11:42:19.595657 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 152/287] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:19 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1722 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:20.621907 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-5e42eaa4-61e7-48f5-ba3d-35954e06764a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:20.622322 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-5e42eaa4-61e7-48f5-ba3d-35954e06764a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:20.634934 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5e42eaa4-61e7-48f5-ba3d-35954e06764a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:20.635445 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5e42eaa4-61e7-48f5-ba3d-35954e06764a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:20.635930 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5e42eaa4-61e7-48f5-ba3d-35954e06764a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:20.637638 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5e42eaa4-61e7-48f5-ba3d-35954e06764a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:20.638264 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5e42eaa4-61e7-48f5-ba3d-35954e06764a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:20.638703 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5e42eaa4-61e7-48f5-ba3d-35954e06764a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:20.918956 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-5e42eaa4-61e7-48f5-ba3d-35954e06764a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:20.930115 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-5e42eaa4-61e7-48f5-ba3d-35954e06764a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1722 microversion: 2.1 time: 0.313517 Oct 18 11:42:20.945983 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 136/288] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:20 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1722 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:21.956182 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-822cdef8-edd2-4c06-a51c-79bd8ad52c19 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:21.956864 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-822cdef8-edd2-4c06-a51c-79bd8ad52c19 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:21.971182 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-822cdef8-edd2-4c06-a51c-79bd8ad52c19 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:21.971689 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-822cdef8-edd2-4c06-a51c-79bd8ad52c19 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:21.972421 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-822cdef8-edd2-4c06-a51c-79bd8ad52c19 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:21.973275 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-822cdef8-edd2-4c06-a51c-79bd8ad52c19 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:21.973935 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-822cdef8-edd2-4c06-a51c-79bd8ad52c19 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:21.974505 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-822cdef8-edd2-4c06-a51c-79bd8ad52c19 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:22.449239 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-822cdef8-edd2-4c06-a51c-79bd8ad52c19 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:22.486761 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-822cdef8-edd2-4c06-a51c-79bd8ad52c19 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1722 microversion: 2.1 time: 0.535327 Oct 18 11:42:22.487354 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 153/289] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:21 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1722 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:22.800259 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-e04cfe81-e258-4827-a40a-d09695ef63b6 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Action: 'create', calling method: .version_select at 0x7f4be03a6e50>, body: {"keypair": {"name": "tempest-keypair-1370828389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC14oSSUVN8OHCpW0WrKYkNtIqIkwDsY2XWDK/yzsCieGIJly75hNfMhbQiyT7rMdTIk8AVvmYHgorCqZteCP9ONGYLGzf1wVerYxZ41853zJ5eXiR+fWBj+q/YGCZh/0A=="}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:42:22.863114 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-e04cfe81-e258-4827-a40a-d09695ef63b6 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Getting quotas for project cd52252f24114465af9bdf6e6fe68b76. Resources: {'key_pairs'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:42:22.890077 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-e04cfe81-e258-4827-a40a-d09695ef63b6 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Getting quotas for user 1f624c36a3574b61bd17d5d73af71916 and project cd52252f24114465af9bdf6e6fe68b76. Resources: {'key_pairs'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:42:22.960984 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:42:22.978913 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-e04cfe81-e258-4827-a40a-d09695ef63b6 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.188019 Oct 18 11:42:22.981095 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 137/290] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Oct 18 11:42:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:42:23.511211 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-a1d8757c-59a0-4f22-b3eb-4877bf7f3222 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:23.511815 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-a1d8757c-59a0-4f22-b3eb-4877bf7f3222 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:23.528343 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a1d8757c-59a0-4f22-b3eb-4877bf7f3222 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:23.533097 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a1d8757c-59a0-4f22-b3eb-4877bf7f3222 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:23.533754 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a1d8757c-59a0-4f22-b3eb-4877bf7f3222 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:23.534674 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a1d8757c-59a0-4f22-b3eb-4877bf7f3222 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:23.535287 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a1d8757c-59a0-4f22-b3eb-4877bf7f3222 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:23.541705 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a1d8757c-59a0-4f22-b3eb-4877bf7f3222 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:24.036131 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-919ff2f5-6822-4a20-b500-55313c5e586e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Action: 'create', calling method: .version_select at 0x7f4be00ee790>, body: {"keypair": {"name": "tempest-keypair-1625554540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAef6/mWR7Psgvb1d7YlXRZQA8SnplIuvXlJKTl/uvaxwJBM3Wmfwg1WRZud6gJiBK8w/ts5WVAamw6dA+eJ+ODb4ASarOM6Mdu/bIPA7+9N7u6xLFHGoim112qRF4hG7g=="}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:42:24.140780 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-919ff2f5-6822-4a20-b500-55313c5e586e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Getting quotas for project 633afaabbbff47a4a99ebc997e67b01a. Resources: {'key_pairs'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:42:24.158353 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-919ff2f5-6822-4a20-b500-55313c5e586e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Getting quotas for user 916699a212eb4d8aa945f299ac0d4c96 and project 633afaabbbff47a4a99ebc997e67b01a. Resources: {'key_pairs'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:42:24.220750 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-919ff2f5-6822-4a20-b500-55313c5e586e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.192834 Oct 18 11:42:24.221554 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 138/291] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Oct 18 11:42:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:42:24.458594 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-a1d8757c-59a0-4f22-b3eb-4877bf7f3222 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:24.520757 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-a1d8757c-59a0-4f22-b3eb-4877bf7f3222 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1722 microversion: 2.1 time: 0.992432 Oct 18 11:42:24.521791 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 154/292] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:23 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1722 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:25.548301 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-19410e1b-39f6-45d3-b13a-6224bedd21c5 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:25.548946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-19410e1b-39f6-45d3-b13a-6224bedd21c5 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:25.563256 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-19410e1b-39f6-45d3-b13a-6224bedd21c5 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:25.564073 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-19410e1b-39f6-45d3-b13a-6224bedd21c5 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:25.564793 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-19410e1b-39f6-45d3-b13a-6224bedd21c5 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:25.566684 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-19410e1b-39f6-45d3-b13a-6224bedd21c5 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:25.569091 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-19410e1b-39f6-45d3-b13a-6224bedd21c5 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:25.570356 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-19410e1b-39f6-45d3-b13a-6224bedd21c5 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:26.649727 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-19410e1b-39f6-45d3-b13a-6224bedd21c5 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:26.666912 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-19410e1b-39f6-45d3-b13a-6224bedd21c5 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1722 microversion: 2.1 time: 1.122889 Oct 18 11:42:26.680945 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 139/293] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:25 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1722 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:27.695026 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-625eaf78-191d-407f-ae17-b16c5cc9f88b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:27.696579 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-625eaf78-191d-407f-ae17-b16c5cc9f88b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:27.743995 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-625eaf78-191d-407f-ae17-b16c5cc9f88b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:27.744479 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-625eaf78-191d-407f-ae17-b16c5cc9f88b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:27.744934 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-625eaf78-191d-407f-ae17-b16c5cc9f88b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:27.745645 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-625eaf78-191d-407f-ae17-b16c5cc9f88b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:27.746096 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-625eaf78-191d-407f-ae17-b16c5cc9f88b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:27.746511 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-625eaf78-191d-407f-ae17-b16c5cc9f88b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:28.313904 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-625eaf78-191d-407f-ae17-b16c5cc9f88b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:28.333740 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-625eaf78-191d-407f-ae17-b16c5cc9f88b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1722 microversion: 2.1 time: 0.644910 Oct 18 11:42:28.334538 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 155/294] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:27 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1722 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:28.666496 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-db024293-012f-404c-9b8b-ecc61545a462 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-624297795", "imageRef": "a4917b56-ebe0-409a-894a-469900c12b94", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d9a6a3c3-a9a4-423b-a361-9c522f10f068"}], "security_groups": [{"name": "tempest-securitygroup--619798919"}], "key_name": "tempest-keypair-1370828389", "user_data": "}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:42:29.435683 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-2374a1e9-186b-49e3-8114-d682ca748ab7 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:29.437269 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-2374a1e9-186b-49e3-8114-d682ca748ab7 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:29.451799 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2374a1e9-186b-49e3-8114-d682ca748ab7 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:29.456293 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2374a1e9-186b-49e3-8114-d682ca748ab7 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:29.459008 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2374a1e9-186b-49e3-8114-d682ca748ab7 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:29.461439 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2374a1e9-186b-49e3-8114-d682ca748ab7 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:29.462692 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2374a1e9-186b-49e3-8114-d682ca748ab7 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:29.467442 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2374a1e9-186b-49e3-8114-d682ca748ab7 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:30.288906 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-2374a1e9-186b-49e3-8114-d682ca748ab7 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:30.306794 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-2374a1e9-186b-49e3-8114-d682ca748ab7 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1722 microversion: 2.1 time: 0.951430 Oct 18 11:42:30.311300 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 156/295] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:29 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1722 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:30.521630 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-74a1982b-0b82-4bbc-9a4f-40e69005fe52 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-436686209", "imageRef": "a4917b56-ebe0-409a-894a-469900c12b94", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb24f3be-68a7-4ca5-a331-f9f5950dbafd"}], "security_groups": [{"name": "tempest-securitygroup--1643466457"}], "key_name": "tempest-keypair-1625554540", "user_data": "}} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:42:34.180695 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell0:SELECT=8 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:42:36.656405 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:42:38.699143 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=15 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:42:40.296885 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:42:40.550468 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_api:SELECT=43 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:42:40.667764 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.network.neutron [None req-db024293-012f-404c-9b8b-ecc61545a462 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] validate_networks() for [('d9a6a3c3-a9a4-423b-a361-9c522f10f068', None, None, None, None, None)] {{(pid=125486) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 11:42:40.669985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.network.neutron [None req-74a1982b-0b82-4bbc-9a4f-40e69005fe52 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] validate_networks() for [('eb24f3be-68a7-4ca5-a331-f9f5950dbafd', None, None, None, None, None)] {{(pid=125485) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 11:42:41.258954 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-db024293-012f-404c-9b8b-ecc61545a462 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Flavor limits 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 11:42:41.259455 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-db024293-012f-404c-9b8b-ecc61545a462 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Image limits 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 11:42:41.259981 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-db024293-012f-404c-9b8b-ecc61545a462 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Flavor pref 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 11:42:41.260574 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-db024293-012f-404c-9b8b-ecc61545a462 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Image pref 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 11:42:41.261170 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-db024293-012f-404c-9b8b-ecc61545a462 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 11:42:41.275327 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-db024293-012f-404c-9b8b-ecc61545a462 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:41.282578 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-db024293-012f-404c-9b8b-ecc61545a462 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:41.283929 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-74a1982b-0b82-4bbc-9a4f-40e69005fe52 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Flavor limits 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 11:42:41.284176 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-db024293-012f-404c-9b8b-ecc61545a462 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:41.284464 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-74a1982b-0b82-4bbc-9a4f-40e69005fe52 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Image limits 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 11:42:41.285255 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-74a1982b-0b82-4bbc-9a4f-40e69005fe52 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Flavor pref 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 11:42:41.285935 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-74a1982b-0b82-4bbc-9a4f-40e69005fe52 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Image pref 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 11:42:41.286169 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-db024293-012f-404c-9b8b-ecc61545a462 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:41.286701 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-74a1982b-0b82-4bbc-9a4f-40e69005fe52 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 11:42:41.289561 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-db024293-012f-404c-9b8b-ecc61545a462 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:41.290393 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-db024293-012f-404c-9b8b-ecc61545a462 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:41.299895 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-74a1982b-0b82-4bbc-9a4f-40e69005fe52 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:41.300430 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-74a1982b-0b82-4bbc-9a4f-40e69005fe52 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:41.300786 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-74a1982b-0b82-4bbc-9a4f-40e69005fe52 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:41.301523 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-74a1982b-0b82-4bbc-9a4f-40e69005fe52 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:41.301961 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-74a1982b-0b82-4bbc-9a4f-40e69005fe52 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:41.302606 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-74a1982b-0b82-4bbc-9a4f-40e69005fe52 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:41.325975 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.quota [None req-74a1982b-0b82-4bbc-9a4f-40e69005fe52 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Getting quotas for project 633afaabbbff47a4a99ebc997e67b01a. Resources: {'cores', 'instances', 'ram'} {{(pid=125485) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:42:41.335764 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.quota [None req-74a1982b-0b82-4bbc-9a4f-40e69005fe52 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Getting quotas for user 916699a212eb4d8aa945f299ac0d4c96 and project 633afaabbbff47a4a99ebc997e67b01a. Resources: {'cores', 'instances', 'ram'} {{(pid=125485) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:42:41.349052 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-db024293-012f-404c-9b8b-ecc61545a462 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Getting quotas for project cd52252f24114465af9bdf6e6fe68b76. Resources: {'cores', 'instances', 'ram'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:42:41.350936 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-74a1982b-0b82-4bbc-9a4f-40e69005fe52 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Going to run 1 instances... {{(pid=125485) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 11:42:41.354083 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-74a1982b-0b82-4bbc-9a4f-40e69005fe52 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4917b56-ebe0-409a-894a-469900c12b94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125485) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 11:42:41.370211 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-db024293-012f-404c-9b8b-ecc61545a462 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Getting quotas for user 1f624c36a3574b61bd17d5d73af71916 and project cd52252f24114465af9bdf6e6fe68b76. Resources: {'cores', 'instances', 'ram'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:42:41.391547 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-db024293-012f-404c-9b8b-ecc61545a462 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Going to run 1 instances... {{(pid=125486) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 11:42:41.395336 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-db024293-012f-404c-9b8b-ecc61545a462 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4917b56-ebe0-409a-894a-469900c12b94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 11:42:41.440970 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-74a1982b-0b82-4bbc-9a4f-40e69005fe52 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 10.924934 Oct 18 11:42:41.450395 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 157/296] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Oct 18 11:42:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 10935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 11:42:41.455671 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-64312aac-7381-411f-8509-82452e5db320 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:41.456519 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-64312aac-7381-411f-8509-82452e5db320 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:41.465064 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-64312aac-7381-411f-8509-82452e5db320 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:41.466924 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-64312aac-7381-411f-8509-82452e5db320 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:41.467674 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-64312aac-7381-411f-8509-82452e5db320 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:41.469175 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-64312aac-7381-411f-8509-82452e5db320 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:41.470449 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-64312aac-7381-411f-8509-82452e5db320 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:41.471176 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-64312aac-7381-411f-8509-82452e5db320 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:41.570873 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-db024293-012f-404c-9b8b-ecc61545a462 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 12.911147 Oct 18 11:42:41.571884 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 140/297] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Oct 18 11:42:28 2022] POST /compute/v2.1/servers => generated 408 bytes in 12913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 11:42:41.730001 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-64312aac-7381-411f-8509-82452e5db320 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:41.744611 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-64312aac-7381-411f-8509-82452e5db320 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1699 microversion: 2.1 time: 0.292659 Oct 18 11:42:41.762173 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 158/298] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:41 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1699 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:41.770452 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-9c33e5f7-8cc9-40ad-b720-ea775b69b15d tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Action: 'create', calling method: .version_select at 0x7f4be02c9ee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1609336397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOI2hkBNcbaGHLlNqjPyc8CIw1K1R6FDOFsJehIERCVwSTB97LppTfNjwe4iqbVCwRnW2a+/INxGMYqqWqYB6KhzuRU5YE05nprvA/FACeOgdysXFR5focceibxDdAWIg=="}} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:42:41.790572 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.quota [None req-9c33e5f7-8cc9-40ad-b720-ea775b69b15d tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Getting quotas for project b63f8bd1dce742b09e413947db416e66. Resources: {'key_pairs'} {{(pid=125485) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:42:41.795790 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.quota [None req-9c33e5f7-8cc9-40ad-b720-ea775b69b15d tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Getting quotas for user b9fed14900304dc99c4c1d5fdfe204af and project b63f8bd1dce742b09e413947db416e66. Resources: {'key_pairs'} {{(pid=125485) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:42:41.832406 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-9c33e5f7-8cc9-40ad-b720-ea775b69b15d tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.068374 Oct 18 11:42:41.833823 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 159/299] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Oct 18 11:42:41 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:42:41.841875 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-3053d014-23ff-418e-9ccb-baa9ac6518ad tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:41.844260 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-3053d014-23ff-418e-9ccb-baa9ac6518ad tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:41.916667 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-3053d014-23ff-418e-9ccb-baa9ac6518ad tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:41.931884 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-3053d014-23ff-418e-9ccb-baa9ac6518ad tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1241 microversion: 2.1 time: 0.095842 Oct 18 11:42:41.933936 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 160/300] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:41 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1241 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:41.941543 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-9137a414-e988-4f35-8310-cb1ecaf5b0f2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:41.942161 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-9137a414-e988-4f35-8310-cb1ecaf5b0f2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:41.946607 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-a2b24393-41ca-43bb-ac1b-4acb33463a36 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Action: 'create', calling method: .version_select at 0x7f4be0101af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-910036943", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ22dlC/fRXdHI9LyFKVH4HQJIgxK8q0NBLJFWWKv/uzAS+4a/XE8v6M4C4tfik6lI2H3qlalhmel3W0bxSfMdZjFWmqzU/9bacWGeuciUcJqpMNOKIo7poGUb6TsjkpTw=="}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:42:41.992517 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-a2b24393-41ca-43bb-ac1b-4acb33463a36 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Getting quotas for project 34d789b867f24711a6c1b5589a573560. Resources: {'key_pairs'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:42:42.002822 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-a2b24393-41ca-43bb-ac1b-4acb33463a36 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Getting quotas for user f76d70b021f44d1391653477c65f95af and project 34d789b867f24711a6c1b5589a573560. Resources: {'key_pairs'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:42:42.078770 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-9137a414-e988-4f35-8310-cb1ecaf5b0f2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:42.087321 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-9137a414-e988-4f35-8310-cb1ecaf5b0f2 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1245 microversion: 2.1 time: 0.152292 Oct 18 11:42:42.088228 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 161/301] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:41 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1245 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:42.090369 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-a2b24393-41ca-43bb-ac1b-4acb33463a36 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.513233 Oct 18 11:42:42.091602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 141/302] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Oct 18 11:42:41 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:42:42.110487 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-380824ee-4c58-4fa9-bc53-7fda255d5e26 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:42:42.117680 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-57e822ba-bc98-475b-8503-b507cb34d326 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-261831381", "imageRef": "ee997e64-7fe5-4d91-854a-24ec6aeb1625", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1609336397", "networks": [{"uuid": "eee6100b-c874-4d5f-a205-43ac4ea120d2"}]}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:42:42.117851 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-380824ee-4c58-4fa9-bc53-7fda255d5e26 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:42.118238 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-380824ee-4c58-4fa9-bc53-7fda255d5e26 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:42.118673 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-380824ee-4c58-4fa9-bc53-7fda255d5e26 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:42.177294 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-380824ee-4c58-4fa9-bc53-7fda255d5e26 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Going to try to start instance {{(pid=125485) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 18 11:42:42.250515 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.network.neutron [None req-57e822ba-bc98-475b-8503-b507cb34d326 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] validate_networks() for [('eee6100b-c874-4d5f-a205-43ac4ea120d2', None, None, None, None, None)] {{(pid=125486) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 11:42:42.313111 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-380824ee-4c58-4fa9-bc53-7fda255d5e26 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "POST /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781/action" status: 202 len: 0 microversion: 2.1 time: 0.206274 Oct 18 11:42:42.314816 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 162/303] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Oct 18 11:42:42 2022] POST /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 11:42:42.325742 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-fd67a751-8f8f-4c62-81ba-471021c5842e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:42.327270 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-fd67a751-8f8f-4c62-81ba-471021c5842e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:42.345091 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fd67a751-8f8f-4c62-81ba-471021c5842e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:42.354961 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fd67a751-8f8f-4c62-81ba-471021c5842e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:42.355439 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fd67a751-8f8f-4c62-81ba-471021c5842e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:42.356797 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fd67a751-8f8f-4c62-81ba-471021c5842e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:42.357372 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fd67a751-8f8f-4c62-81ba-471021c5842e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:42.358031 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fd67a751-8f8f-4c62-81ba-471021c5842e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:42.639888 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-fd67a751-8f8f-4c62-81ba-471021c5842e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:42.653884 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-fd67a751-8f8f-4c62-81ba-471021c5842e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1708 microversion: 2.1 time: 0.333143 Oct 18 11:42:42.670598 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 163/304] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:42 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1708 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:42.956138 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-5e7a9a1b-fec4-44b3-98cc-98467191f8e7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:42.956755 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-5e7a9a1b-fec4-44b3-98cc-98467191f8e7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:42.964213 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5e7a9a1b-fec4-44b3-98cc-98467191f8e7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:42.964704 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5e7a9a1b-fec4-44b3-98cc-98467191f8e7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:42.965163 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5e7a9a1b-fec4-44b3-98cc-98467191f8e7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:42.975219 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5e7a9a1b-fec4-44b3-98cc-98467191f8e7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:42.981600 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5e7a9a1b-fec4-44b3-98cc-98467191f8e7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:42.982088 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5e7a9a1b-fec4-44b3-98cc-98467191f8e7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:43.146112 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-5e7a9a1b-fec4-44b3-98cc-98467191f8e7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:43.159329 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-5e7a9a1b-fec4-44b3-98cc-98467191f8e7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1237 microversion: 2.1 time: 0.207182 Oct 18 11:42:43.161039 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 164/305] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:42 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1237 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:43.191712 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-dd90a2d0-eb51-400f-9fac-6c5279c22863 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:43.197983 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-dd90a2d0-eb51-400f-9fac-6c5279c22863 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:43.215929 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-dd90a2d0-eb51-400f-9fac-6c5279c22863 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:43.216712 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-dd90a2d0-eb51-400f-9fac-6c5279c22863 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:43.217653 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-dd90a2d0-eb51-400f-9fac-6c5279c22863 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:43.220644 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-dd90a2d0-eb51-400f-9fac-6c5279c22863 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:43.221778 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-dd90a2d0-eb51-400f-9fac-6c5279c22863 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:43.223075 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-dd90a2d0-eb51-400f-9fac-6c5279c22863 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:43.275507 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-57e822ba-bc98-475b-8503-b507cb34d326 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Flavor limits 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 11:42:43.276056 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-57e822ba-bc98-475b-8503-b507cb34d326 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Image limits 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 11:42:43.276381 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-57e822ba-bc98-475b-8503-b507cb34d326 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Flavor pref 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 11:42:43.277143 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-57e822ba-bc98-475b-8503-b507cb34d326 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Image pref 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 11:42:43.277714 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-57e822ba-bc98-475b-8503-b507cb34d326 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 11:42:43.289562 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-57e822ba-bc98-475b-8503-b507cb34d326 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:43.292789 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-57e822ba-bc98-475b-8503-b507cb34d326 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:43.293615 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-57e822ba-bc98-475b-8503-b507cb34d326 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:43.294801 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-57e822ba-bc98-475b-8503-b507cb34d326 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:43.295857 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-57e822ba-bc98-475b-8503-b507cb34d326 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:43.296444 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-57e822ba-bc98-475b-8503-b507cb34d326 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:43.321381 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-57e822ba-bc98-475b-8503-b507cb34d326 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Getting quotas for project b63f8bd1dce742b09e413947db416e66. Resources: {'cores', 'instances', 'ram'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:42:43.326100 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-57e822ba-bc98-475b-8503-b507cb34d326 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Getting quotas for user b9fed14900304dc99c4c1d5fdfe204af and project b63f8bd1dce742b09e413947db416e66. Resources: {'cores', 'instances', 'ram'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:42:43.333701 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-dd90a2d0-eb51-400f-9fac-6c5279c22863 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:43.341623 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-57e822ba-bc98-475b-8503-b507cb34d326 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Going to run 1 instances... {{(pid=125486) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 11:42:43.345194 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-dd90a2d0-eb51-400f-9fac-6c5279c22863 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1297 microversion: 2.1 time: 0.178808 Oct 18 11:42:43.346777 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-57e822ba-bc98-475b-8503-b507cb34d326 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ee997e64-7fe5-4d91-854a-24ec6aeb1625',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 11:42:43.350915 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 165/306] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:43 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1297 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:43.431253 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-57e822ba-bc98-475b-8503-b507cb34d326 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.324119 Oct 18 11:42:43.432341 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 142/307] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Oct 18 11:42:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 11:42:43.450423 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-3c6cbcaa-4987-41a7-ab18-cc0c987f8f4d tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:43.451096 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-3c6cbcaa-4987-41a7-ab18-cc0c987f8f4d tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:43.682502 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-22aef8ee-185c-45f4-8bb8-257132a021fc tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:43.684590 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-22aef8ee-185c-45f4-8bb8-257132a021fc tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:43.699020 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-22aef8ee-185c-45f4-8bb8-257132a021fc tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:43.713894 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-22aef8ee-185c-45f4-8bb8-257132a021fc tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:43.716296 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-22aef8ee-185c-45f4-8bb8-257132a021fc tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:43.721011 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-22aef8ee-185c-45f4-8bb8-257132a021fc tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:43.727795 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-22aef8ee-185c-45f4-8bb8-257132a021fc tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:43.731981 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-22aef8ee-185c-45f4-8bb8-257132a021fc tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:43.847115 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-3c6cbcaa-4987-41a7-ab18-cc0c987f8f4d tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:43.865012 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-3c6cbcaa-4987-41a7-ab18-cc0c987f8f4d tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1258 microversion: 2.1 time: 0.417481 Oct 18 11:42:43.865721 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 166/308] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:43 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1258 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:44.188584 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-08e2318f-321d-4738-b2c0-6e628c8f6653 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:44.189617 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-08e2318f-321d-4738-b2c0-6e628c8f6653 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:44.210981 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-08e2318f-321d-4738-b2c0-6e628c8f6653 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:44.214709 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-08e2318f-321d-4738-b2c0-6e628c8f6653 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:44.220680 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-08e2318f-321d-4738-b2c0-6e628c8f6653 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:44.225784 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-08e2318f-321d-4738-b2c0-6e628c8f6653 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:44.229938 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-08e2318f-321d-4738-b2c0-6e628c8f6653 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:44.230579 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-08e2318f-321d-4738-b2c0-6e628c8f6653 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:44.543364 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-08e2318f-321d-4738-b2c0-6e628c8f6653 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:44.555659 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-08e2318f-321d-4738-b2c0-6e628c8f6653 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1293 microversion: 2.1 time: 0.375162 Oct 18 11:42:44.555928 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-22aef8ee-185c-45f4-8bb8-257132a021fc tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:44.573097 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-22aef8ee-185c-45f4-8bb8-257132a021fc tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1708 microversion: 2.1 time: 0.895005 Oct 18 11:42:44.577139 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 167/309] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:44 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1293 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:44.577261 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 143/310] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:43 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1708 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:44.584877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-64c0e926-be73-455e-8e12-1f93203fc0d4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:44.584877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-64c0e926-be73-455e-8e12-1f93203fc0d4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:44.616094 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-64c0e926-be73-455e-8e12-1f93203fc0d4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:44.616668 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-64c0e926-be73-455e-8e12-1f93203fc0d4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:44.620345 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-64c0e926-be73-455e-8e12-1f93203fc0d4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:44.621112 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-64c0e926-be73-455e-8e12-1f93203fc0d4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:44.621617 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-64c0e926-be73-455e-8e12-1f93203fc0d4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:44.622030 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-64c0e926-be73-455e-8e12-1f93203fc0d4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:44.785534 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-64c0e926-be73-455e-8e12-1f93203fc0d4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:44.815652 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-64c0e926-be73-455e-8e12-1f93203fc0d4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1303 microversion: 2.1 time: 0.240566 Oct 18 11:42:44.818357 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 168/311] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:44 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1303 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:44.896266 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-ef16f3cf-c4dc-42b5-b9f9-2ec8a73ee356 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:44.897566 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-ef16f3cf-c4dc-42b5-b9f9-2ec8a73ee356 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:44.918942 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ef16f3cf-c4dc-42b5-b9f9-2ec8a73ee356 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:44.920195 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ef16f3cf-c4dc-42b5-b9f9-2ec8a73ee356 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:44.921139 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ef16f3cf-c4dc-42b5-b9f9-2ec8a73ee356 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:44.924646 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ef16f3cf-c4dc-42b5-b9f9-2ec8a73ee356 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:44.926750 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ef16f3cf-c4dc-42b5-b9f9-2ec8a73ee356 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:44.929057 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ef16f3cf-c4dc-42b5-b9f9-2ec8a73ee356 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:45.211004 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-ef16f3cf-c4dc-42b5-b9f9-2ec8a73ee356 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:45.227483 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-ef16f3cf-c4dc-42b5-b9f9-2ec8a73ee356 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1262 microversion: 2.1 time: 0.337505 Oct 18 11:42:45.231408 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 144/312] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:44 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1262 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:45.608350 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-8feaa15f-48f2-4f06-a08c-7b10ae829596 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:45.610932 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-675a12dc-f503-48a3-b5d0-21ebc88ca34f tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:45.612651 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-8feaa15f-48f2-4f06-a08c-7b10ae829596 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:45.613530 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-675a12dc-f503-48a3-b5d0-21ebc88ca34f tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:45.635035 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-675a12dc-f503-48a3-b5d0-21ebc88ca34f tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:45.635914 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-675a12dc-f503-48a3-b5d0-21ebc88ca34f tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:45.636787 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8feaa15f-48f2-4f06-a08c-7b10ae829596 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:45.637433 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-675a12dc-f503-48a3-b5d0-21ebc88ca34f tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:45.639943 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8feaa15f-48f2-4f06-a08c-7b10ae829596 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:45.641120 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8feaa15f-48f2-4f06-a08c-7b10ae829596 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:45.642338 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-675a12dc-f503-48a3-b5d0-21ebc88ca34f tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:45.643483 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8feaa15f-48f2-4f06-a08c-7b10ae829596 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:45.645032 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-675a12dc-f503-48a3-b5d0-21ebc88ca34f tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:45.646535 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-675a12dc-f503-48a3-b5d0-21ebc88ca34f tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:45.647793 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8feaa15f-48f2-4f06-a08c-7b10ae829596 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:45.649553 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8feaa15f-48f2-4f06-a08c-7b10ae829596 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:45.853242 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-8feaa15f-48f2-4f06-a08c-7b10ae829596 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:45.864803 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-8feaa15f-48f2-4f06-a08c-7b10ae829596 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1299 microversion: 2.1 time: 0.270851 Oct 18 11:42:45.869297 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 169/313] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:45 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1299 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:45.938904 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-53328808-17f3-4903-bf4b-200a834184e4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:45.947770 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-53328808-17f3-4903-bf4b-200a834184e4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:45.964770 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-53328808-17f3-4903-bf4b-200a834184e4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:45.965538 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-53328808-17f3-4903-bf4b-200a834184e4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:45.966380 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-53328808-17f3-4903-bf4b-200a834184e4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:45.967510 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-53328808-17f3-4903-bf4b-200a834184e4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:45.968358 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-53328808-17f3-4903-bf4b-200a834184e4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:45.969163 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-53328808-17f3-4903-bf4b-200a834184e4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:46.216258 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-53328808-17f3-4903-bf4b-200a834184e4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:46.244919 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-53328808-17f3-4903-bf4b-200a834184e4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1303 microversion: 2.1 time: 0.372823 Oct 18 11:42:46.246094 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 170/314] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:45 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1303 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:46.276655 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-21806e31-10e1-449f-8082-e66ecf8b1e42 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:46.314961 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-21806e31-10e1-449f-8082-e66ecf8b1e42 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:46.352644 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-21806e31-10e1-449f-8082-e66ecf8b1e42 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:46.355465 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-21806e31-10e1-449f-8082-e66ecf8b1e42 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:46.361372 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-21806e31-10e1-449f-8082-e66ecf8b1e42 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:46.362212 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-21806e31-10e1-449f-8082-e66ecf8b1e42 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:46.362772 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-21806e31-10e1-449f-8082-e66ecf8b1e42 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:46.363208 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-21806e31-10e1-449f-8082-e66ecf8b1e42 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:46.597979 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-675a12dc-f503-48a3-b5d0-21ebc88ca34f tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:46.622290 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-675a12dc-f503-48a3-b5d0-21ebc88ca34f tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1708 microversion: 2.1 time: 1.015381 Oct 18 11:42:46.624501 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 145/315] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:45 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1708 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:46.624803 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-21806e31-10e1-449f-8082-e66ecf8b1e42 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:46.643520 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-21806e31-10e1-449f-8082-e66ecf8b1e42 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1310 microversion: 2.1 time: 0.382671 Oct 18 11:42:46.644109 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 171/316] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:46 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1310 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:46.895517 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-e42b1128-33e7-4c55-94d7-4e32afe6ac2c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:46.896140 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-e42b1128-33e7-4c55-94d7-4e32afe6ac2c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:46.911581 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e42b1128-33e7-4c55-94d7-4e32afe6ac2c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:46.913425 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e42b1128-33e7-4c55-94d7-4e32afe6ac2c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:46.917044 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e42b1128-33e7-4c55-94d7-4e32afe6ac2c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:46.917999 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e42b1128-33e7-4c55-94d7-4e32afe6ac2c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:46.924219 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e42b1128-33e7-4c55-94d7-4e32afe6ac2c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:46.925317 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e42b1128-33e7-4c55-94d7-4e32afe6ac2c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:47.269533 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-4bbb2c59-082e-44e8-9a26-457b2a3f9f6a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:47.270177 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-4bbb2c59-082e-44e8-9a26-457b2a3f9f6a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:47.282598 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4bbb2c59-082e-44e8-9a26-457b2a3f9f6a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:47.283096 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4bbb2c59-082e-44e8-9a26-457b2a3f9f6a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:47.283532 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4bbb2c59-082e-44e8-9a26-457b2a3f9f6a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:47.284248 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4bbb2c59-082e-44e8-9a26-457b2a3f9f6a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:47.284740 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4bbb2c59-082e-44e8-9a26-457b2a3f9f6a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:47.288989 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4bbb2c59-082e-44e8-9a26-457b2a3f9f6a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:47.512617 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-e42b1128-33e7-4c55-94d7-4e32afe6ac2c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:47.530440 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-e42b1128-33e7-4c55-94d7-4e32afe6ac2c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1367 microversion: 2.1 time: 0.630080 Oct 18 11:42:47.535017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 146/317] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:46 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1367 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:47.649346 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-06ebe333-5df9-43ec-851f-2b9009cb435b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:47.649993 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-06ebe333-5df9-43ec-851f-2b9009cb435b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:47.661537 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-06ebe333-5df9-43ec-851f-2b9009cb435b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:47.673274 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-06ebe333-5df9-43ec-851f-2b9009cb435b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:47.673913 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-06ebe333-5df9-43ec-851f-2b9009cb435b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:47.682253 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-06ebe333-5df9-43ec-851f-2b9009cb435b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:47.682811 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-06ebe333-5df9-43ec-851f-2b9009cb435b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:47.686512 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-06ebe333-5df9-43ec-851f-2b9009cb435b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:48.184225 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-06ebe333-5df9-43ec-851f-2b9009cb435b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:48.195574 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-06ebe333-5df9-43ec-851f-2b9009cb435b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1712 microversion: 2.1 time: 0.549296 Oct 18 11:42:48.197892 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 147/318] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:47 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1712 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:48.211499 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-59a629e7-935e-4b09-9d23-92b435014bf6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:48.212781 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-59a629e7-935e-4b09-9d23-92b435014bf6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:48.229185 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-59a629e7-935e-4b09-9d23-92b435014bf6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:48.231374 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-59a629e7-935e-4b09-9d23-92b435014bf6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:48.231997 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-59a629e7-935e-4b09-9d23-92b435014bf6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:48.232976 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-59a629e7-935e-4b09-9d23-92b435014bf6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:48.233592 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-59a629e7-935e-4b09-9d23-92b435014bf6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:48.234192 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-59a629e7-935e-4b09-9d23-92b435014bf6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:48.287651 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-4bbb2c59-082e-44e8-9a26-457b2a3f9f6a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:48.305225 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-4bbb2c59-082e-44e8-9a26-457b2a3f9f6a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1370 microversion: 2.1 time: 1.039463 Oct 18 11:42:48.306371 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 172/319] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:47 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1370 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:48.561446 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-0be711ea-84c6-459a-9d18-72e10a164672 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:48.562308 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-0be711ea-84c6-459a-9d18-72e10a164672 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:48.578155 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0be711ea-84c6-459a-9d18-72e10a164672 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:48.578985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0be711ea-84c6-459a-9d18-72e10a164672 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:48.579608 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0be711ea-84c6-459a-9d18-72e10a164672 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:48.580508 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0be711ea-84c6-459a-9d18-72e10a164672 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:48.581158 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0be711ea-84c6-459a-9d18-72e10a164672 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:48.581848 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0be711ea-84c6-459a-9d18-72e10a164672 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:48.924111 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-59a629e7-935e-4b09-9d23-92b435014bf6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:48.950840 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-59a629e7-935e-4b09-9d23-92b435014bf6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1316 microversion: 2.1 time: 0.751501 Oct 18 11:42:48.971044 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 148/320] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:48 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1316 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:48.977587 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-ff2eb92b-d104-445a-b1b4-8d4051a72a55 req-f3f8b5d4-b73e-490b-a935-9459b640ae9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f737271-603e-4448-b37d-4a5ae83dd052", "tag": "068b5a44-602c-41f5-93ae-92aab177d2c9"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:42:48.990807 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-ff2eb92b-d104-445a-b1b4-8d4051a72a55 req-f3f8b5d4-b73e-490b-a935-9459b640ae9d service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:48.991617 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-ff2eb92b-d104-445a-b1b4-8d4051a72a55 req-f3f8b5d4-b73e-490b-a935-9459b640ae9d service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:48.992240 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-ff2eb92b-d104-445a-b1b4-8d4051a72a55 req-f3f8b5d4-b73e-490b-a935-9459b640ae9d service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:49.009492 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-ff2eb92b-d104-445a-b1b4-8d4051a72a55 req-f3f8b5d4-b73e-490b-a935-9459b640ae9d service nova] Creating event network-changed:068b5a44-602c-41f5-93ae-92aab177d2c9 for instance 3f737271-603e-4448-b37d-4a5ae83dd052 on hv-cinder-81558 Oct 18 11:42:49.015154 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-ff2eb92b-d104-445a-b1b4-8d4051a72a55 req-f3f8b5d4-b73e-490b-a935-9459b640ae9d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042371 Oct 18 11:42:49.019674 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 149/321] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:42:49.141791 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-0be711ea-84c6-459a-9d18-72e10a164672 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:49.153965 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-0be711ea-84c6-459a-9d18-72e10a164672 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1367 microversion: 2.1 time: 0.596174 Oct 18 11:42:49.169494 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 173/322] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:48 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1367 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:42:49.334631 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-12214214-708a-4a75-af79-4bf4c6790a74 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:49.335549 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-12214214-708a-4a75-af79-4bf4c6790a74 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:49.361648 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-12214214-708a-4a75-af79-4bf4c6790a74 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:49.362526 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-12214214-708a-4a75-af79-4bf4c6790a74 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:49.362643 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-12214214-708a-4a75-af79-4bf4c6790a74 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:49.371211 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-12214214-708a-4a75-af79-4bf4c6790a74 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:49.372511 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-12214214-708a-4a75-af79-4bf4c6790a74 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:49.373006 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-12214214-708a-4a75-af79-4bf4c6790a74 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:49.979749 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-52544e67-b528-4632-b0ad-c00485cf2c1b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:49.980348 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-52544e67-b528-4632-b0ad-c00485cf2c1b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:49.988641 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-52544e67-b528-4632-b0ad-c00485cf2c1b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:49.989524 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-52544e67-b528-4632-b0ad-c00485cf2c1b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:49.990823 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-52544e67-b528-4632-b0ad-c00485cf2c1b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:49.991763 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-52544e67-b528-4632-b0ad-c00485cf2c1b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:49.993045 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-52544e67-b528-4632-b0ad-c00485cf2c1b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:49.993920 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-52544e67-b528-4632-b0ad-c00485cf2c1b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:50.084713 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-12214214-708a-4a75-af79-4bf4c6790a74 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:50.107500 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-12214214-708a-4a75-af79-4bf4c6790a74 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1370 microversion: 2.1 time: 0.774096 Oct 18 11:42:50.108725 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 150/323] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:49 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1370 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:50.215383 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-857c596b-301b-42d7-a503-71c0fd14dff7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:50.217194 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-857c596b-301b-42d7-a503-71c0fd14dff7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:50.235511 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-857c596b-301b-42d7-a503-71c0fd14dff7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:50.242096 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-857c596b-301b-42d7-a503-71c0fd14dff7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:50.245020 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-857c596b-301b-42d7-a503-71c0fd14dff7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:50.253638 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-857c596b-301b-42d7-a503-71c0fd14dff7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:50.255315 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-857c596b-301b-42d7-a503-71c0fd14dff7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:50.257285 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-857c596b-301b-42d7-a503-71c0fd14dff7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:50.688149 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-52544e67-b528-4632-b0ad-c00485cf2c1b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:50.702304 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-52544e67-b528-4632-b0ad-c00485cf2c1b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1358 microversion: 2.1 time: 0.724388 Oct 18 11:42:50.717214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 174/324] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:49 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1358 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:42:51.161523 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-857c596b-301b-42d7-a503-71c0fd14dff7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:51.177775 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-857c596b-301b-42d7-a503-71c0fd14dff7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1367 microversion: 2.1 time: 0.996361 Oct 18 11:42:51.189673 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 151/325] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:50 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1367 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:51.193913 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-1c49ff0b-7423-4188-973b-696717d1a7bd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:51.194967 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-1c49ff0b-7423-4188-973b-696717d1a7bd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:51.224588 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1c49ff0b-7423-4188-973b-696717d1a7bd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:51.226661 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1c49ff0b-7423-4188-973b-696717d1a7bd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:51.227689 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1c49ff0b-7423-4188-973b-696717d1a7bd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:51.229228 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1c49ff0b-7423-4188-973b-696717d1a7bd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:51.230302 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1c49ff0b-7423-4188-973b-696717d1a7bd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:51.231314 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1c49ff0b-7423-4188-973b-696717d1a7bd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:51.317450 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell0:SELECT=2 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:42:51.504138 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-1c49ff0b-7423-4188-973b-696717d1a7bd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:51.516885 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-1c49ff0b-7423-4188-973b-696717d1a7bd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1370 microversion: 2.1 time: 0.330054 Oct 18 11:42:51.538263 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-a97d6041-7f4c-4592-a41b-8889dbf2ac9c req-c81c41ca-7050-4dd7-901a-b759c2310a2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ea63cc8-527d-46ea-b6ef-d778dadb8ec5", "tag": "c6da8082-87ec-4172-bf6f-d60ef1511c4e"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:42:51.539897 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 175/326] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:51 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1370 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:42:51.553896 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-a97d6041-7f4c-4592-a41b-8889dbf2ac9c req-c81c41ca-7050-4dd7-901a-b759c2310a2f service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:51.554374 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-a97d6041-7f4c-4592-a41b-8889dbf2ac9c req-c81c41ca-7050-4dd7-901a-b759c2310a2f service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:51.555097 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-a97d6041-7f4c-4592-a41b-8889dbf2ac9c req-c81c41ca-7050-4dd7-901a-b759c2310a2f service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:51.573297 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-a97d6041-7f4c-4592-a41b-8889dbf2ac9c req-c81c41ca-7050-4dd7-901a-b759c2310a2f service nova] Creating event network-changed:c6da8082-87ec-4172-bf6f-d60ef1511c4e for instance 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 on hv-cinder-81558 Oct 18 11:42:51.579894 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-a97d6041-7f4c-4592-a41b-8889dbf2ac9c req-c81c41ca-7050-4dd7-901a-b759c2310a2f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049474 Oct 18 11:42:51.580495 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 152/327] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:42:51.726995 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-f6391a10-39a5-4d2f-8ab4-aa4f907f02d6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:51.727612 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-f6391a10-39a5-4d2f-8ab4-aa4f907f02d6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:51.735649 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f6391a10-39a5-4d2f-8ab4-aa4f907f02d6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:51.737164 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f6391a10-39a5-4d2f-8ab4-aa4f907f02d6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:51.737164 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f6391a10-39a5-4d2f-8ab4-aa4f907f02d6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:51.737350 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f6391a10-39a5-4d2f-8ab4-aa4f907f02d6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:51.737720 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f6391a10-39a5-4d2f-8ab4-aa4f907f02d6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:51.738329 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f6391a10-39a5-4d2f-8ab4-aa4f907f02d6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:51.915963 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-f6391a10-39a5-4d2f-8ab4-aa4f907f02d6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:51.928834 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-f6391a10-39a5-4d2f-8ab4-aa4f907f02d6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1358 microversion: 2.1 time: 0.205634 Oct 18 11:42:51.929903 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 176/328] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:51 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:42:52.204244 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-e76efacb-5935-4a22-b8cd-9d67a69ce59a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:52.206049 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-e76efacb-5935-4a22-b8cd-9d67a69ce59a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:52.227085 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e76efacb-5935-4a22-b8cd-9d67a69ce59a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:52.232257 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e76efacb-5935-4a22-b8cd-9d67a69ce59a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:52.233635 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e76efacb-5935-4a22-b8cd-9d67a69ce59a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:52.237439 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e76efacb-5935-4a22-b8cd-9d67a69ce59a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:52.241944 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e76efacb-5935-4a22-b8cd-9d67a69ce59a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:52.242581 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e76efacb-5935-4a22-b8cd-9d67a69ce59a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:52.413212 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-e76efacb-5935-4a22-b8cd-9d67a69ce59a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:52.422501 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-e76efacb-5935-4a22-b8cd-9d67a69ce59a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1367 microversion: 2.1 time: 0.224185 Oct 18 11:42:52.437853 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 153/329] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:52 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:52.544517 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-f25e91a9-fcda-4f29-a6db-9ab3c8ca448a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:52.545111 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-f25e91a9-fcda-4f29-a6db-9ab3c8ca448a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:52.552834 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f25e91a9-fcda-4f29-a6db-9ab3c8ca448a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:52.553595 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f25e91a9-fcda-4f29-a6db-9ab3c8ca448a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:52.554014 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f25e91a9-fcda-4f29-a6db-9ab3c8ca448a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:52.554717 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f25e91a9-fcda-4f29-a6db-9ab3c8ca448a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:52.555164 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f25e91a9-fcda-4f29-a6db-9ab3c8ca448a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:52.555584 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f25e91a9-fcda-4f29-a6db-9ab3c8ca448a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:52.572114 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:42:52.725397 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-f25e91a9-fcda-4f29-a6db-9ab3c8ca448a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:52.734005 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-f25e91a9-fcda-4f29-a6db-9ab3c8ca448a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1370 microversion: 2.1 time: 0.193719 Oct 18 11:42:52.735058 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 177/330] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:52 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1370 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:52.958937 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-6347e56d-fa6e-48f5-a09f-2cd2e90c797c tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:52.959554 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-6347e56d-fa6e-48f5-a09f-2cd2e90c797c tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:52.965951 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6347e56d-fa6e-48f5-a09f-2cd2e90c797c tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:52.966433 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6347e56d-fa6e-48f5-a09f-2cd2e90c797c tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:52.966863 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6347e56d-fa6e-48f5-a09f-2cd2e90c797c tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:52.967548 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6347e56d-fa6e-48f5-a09f-2cd2e90c797c tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:52.967999 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6347e56d-fa6e-48f5-a09f-2cd2e90c797c tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:52.968419 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6347e56d-fa6e-48f5-a09f-2cd2e90c797c tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:53.131627 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-6347e56d-fa6e-48f5-a09f-2cd2e90c797c tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:53.140969 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-6347e56d-fa6e-48f5-a09f-2cd2e90c797c tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1358 microversion: 2.1 time: 0.186144 Oct 18 11:42:53.141548 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 154/331] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:52 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:53.449625 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-1894a4f7-09c9-45e6-bdde-4ffbfcc8bd89 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:53.450418 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-1894a4f7-09c9-45e6-bdde-4ffbfcc8bd89 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:53.456651 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1894a4f7-09c9-45e6-bdde-4ffbfcc8bd89 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:53.457177 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1894a4f7-09c9-45e6-bdde-4ffbfcc8bd89 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:53.457809 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1894a4f7-09c9-45e6-bdde-4ffbfcc8bd89 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:53.458574 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1894a4f7-09c9-45e6-bdde-4ffbfcc8bd89 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:53.459533 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1894a4f7-09c9-45e6-bdde-4ffbfcc8bd89 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:53.459951 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1894a4f7-09c9-45e6-bdde-4ffbfcc8bd89 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:53.598094 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-2be71888-c396-4153-bdfe-a8d0233c61b4 req-5c667088-73ea-4a66-9362-e6a4078f6276 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fc6ee0a-b135-42dc-9099-30672626af2e", "tag": "dad12b9b-8fc3-457f-a59d-d7e7760984cc"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:42:53.603610 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-1894a4f7-09c9-45e6-bdde-4ffbfcc8bd89 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:53.607655 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell0:SELECT=4 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:42:53.608516 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell0:SELECT=16 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:42:53.612868 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-1894a4f7-09c9-45e6-bdde-4ffbfcc8bd89 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1367 microversion: 2.1 time: 0.168508 Oct 18 11:42:53.614095 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 178/332] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:53 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:53.617658 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-2be71888-c396-4153-bdfe-a8d0233c61b4 req-5c667088-73ea-4a66-9362-e6a4078f6276 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:53.618535 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-2be71888-c396-4153-bdfe-a8d0233c61b4 req-5c667088-73ea-4a66-9362-e6a4078f6276 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:53.619035 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-2be71888-c396-4153-bdfe-a8d0233c61b4 req-5c667088-73ea-4a66-9362-e6a4078f6276 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:53.633087 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-2be71888-c396-4153-bdfe-a8d0233c61b4 req-5c667088-73ea-4a66-9362-e6a4078f6276 service nova] Creating event network-changed:dad12b9b-8fc3-457f-a59d-d7e7760984cc for instance 0fc6ee0a-b135-42dc-9099-30672626af2e on hv-cinder-81558 Oct 18 11:42:53.640394 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-2be71888-c396-4153-bdfe-a8d0233c61b4 req-5c667088-73ea-4a66-9362-e6a4078f6276 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046734 Oct 18 11:42:53.641092 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 155/333] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:42:53.762949 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-68e689f1-6ee2-4fea-beed-744daa718752 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:53.763672 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-68e689f1-6ee2-4fea-beed-744daa718752 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:53.770019 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-68e689f1-6ee2-4fea-beed-744daa718752 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:53.770592 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-68e689f1-6ee2-4fea-beed-744daa718752 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:53.776366 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-68e689f1-6ee2-4fea-beed-744daa718752 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:53.777281 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-68e689f1-6ee2-4fea-beed-744daa718752 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:53.777833 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-68e689f1-6ee2-4fea-beed-744daa718752 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:53.778336 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-68e689f1-6ee2-4fea-beed-744daa718752 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:53.851710 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell0:SELECT=16 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:42:53.986663 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-68e689f1-6ee2-4fea-beed-744daa718752 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:53.996311 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-68e689f1-6ee2-4fea-beed-744daa718752 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1370 microversion: 2.1 time: 0.237115 Oct 18 11:42:53.996924 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 179/334] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:53 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1370 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:54.166269 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-7054308a-25e8-4c8b-b86c-4133b689c756 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:54.166965 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-7054308a-25e8-4c8b-b86c-4133b689c756 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:54.173213 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7054308a-25e8-4c8b-b86c-4133b689c756 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:54.173695 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7054308a-25e8-4c8b-b86c-4133b689c756 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:54.174132 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7054308a-25e8-4c8b-b86c-4133b689c756 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:54.174844 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7054308a-25e8-4c8b-b86c-4133b689c756 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:54.175278 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7054308a-25e8-4c8b-b86c-4133b689c756 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:54.175696 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7054308a-25e8-4c8b-b86c-4133b689c756 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:54.337695 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-7054308a-25e8-4c8b-b86c-4133b689c756 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:54.345826 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-7054308a-25e8-4c8b-b86c-4133b689c756 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1358 microversion: 2.1 time: 0.184302 Oct 18 11:42:54.346403 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 156/335] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:54 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:54.636046 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ce631277-53bd-4852-9b54-c15366752e62 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:54.636636 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-ce631277-53bd-4852-9b54-c15366752e62 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:54.643721 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ce631277-53bd-4852-9b54-c15366752e62 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:54.644220 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ce631277-53bd-4852-9b54-c15366752e62 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:54.644662 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ce631277-53bd-4852-9b54-c15366752e62 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:54.645478 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ce631277-53bd-4852-9b54-c15366752e62 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:54.645933 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ce631277-53bd-4852-9b54-c15366752e62 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:54.646575 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ce631277-53bd-4852-9b54-c15366752e62 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:54.801503 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-ce631277-53bd-4852-9b54-c15366752e62 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:54.816322 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-ce631277-53bd-4852-9b54-c15366752e62 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1367 microversion: 2.1 time: 0.183950 Oct 18 11:42:54.829494 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 180/336] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:54 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:55.019619 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-cdbbe80e-c362-4c0e-a8b5-e82c99257ab5 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:55.020249 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-cdbbe80e-c362-4c0e-a8b5-e82c99257ab5 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:55.028071 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cdbbe80e-c362-4c0e-a8b5-e82c99257ab5 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:55.028607 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cdbbe80e-c362-4c0e-a8b5-e82c99257ab5 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:55.029123 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cdbbe80e-c362-4c0e-a8b5-e82c99257ab5 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:55.029860 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cdbbe80e-c362-4c0e-a8b5-e82c99257ab5 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:55.030348 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cdbbe80e-c362-4c0e-a8b5-e82c99257ab5 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:55.030804 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cdbbe80e-c362-4c0e-a8b5-e82c99257ab5 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:55.227653 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-cdbbe80e-c362-4c0e-a8b5-e82c99257ab5 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:55.237664 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-cdbbe80e-c362-4c0e-a8b5-e82c99257ab5 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1370 microversion: 2.1 time: 0.221646 Oct 18 11:42:55.239833 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 157/337] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:55 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1370 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:55.371164 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-c3f154d6-8335-4ce3-83b4-6151ebff4db3 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:55.371762 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-c3f154d6-8335-4ce3-83b4-6151ebff4db3 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:55.377865 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c3f154d6-8335-4ce3-83b4-6151ebff4db3 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:55.378347 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c3f154d6-8335-4ce3-83b4-6151ebff4db3 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:55.378780 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c3f154d6-8335-4ce3-83b4-6151ebff4db3 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:55.379497 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c3f154d6-8335-4ce3-83b4-6151ebff4db3 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:55.379919 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c3f154d6-8335-4ce3-83b4-6151ebff4db3 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:55.380334 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c3f154d6-8335-4ce3-83b4-6151ebff4db3 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:55.531460 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-c3f154d6-8335-4ce3-83b4-6151ebff4db3 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:55.539295 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-c3f154d6-8335-4ce3-83b4-6151ebff4db3 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1358 microversion: 2.1 time: 0.172041 Oct 18 11:42:55.539876 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 181/338] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:55 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:55.842477 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-fa0e0863-6c7a-4a73-b1fb-0db3149cbf59 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:55.843486 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-fa0e0863-6c7a-4a73-b1fb-0db3149cbf59 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:55.852194 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fa0e0863-6c7a-4a73-b1fb-0db3149cbf59 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:55.852693 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fa0e0863-6c7a-4a73-b1fb-0db3149cbf59 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:55.853202 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fa0e0863-6c7a-4a73-b1fb-0db3149cbf59 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:55.853908 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fa0e0863-6c7a-4a73-b1fb-0db3149cbf59 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:55.854363 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fa0e0863-6c7a-4a73-b1fb-0db3149cbf59 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:55.854786 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fa0e0863-6c7a-4a73-b1fb-0db3149cbf59 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:56.029121 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-97a8c721-7da2-452c-9f57-0cc07758c3c5 req-f531a91e-2d32-412a-99eb-c682fd04170a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f737271-603e-4448-b37d-4a5ae83dd052", "name": "network-vif-plugged", "status": "completed", "tag": "068b5a44-602c-41f5-93ae-92aab177d2c9"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:42:56.042884 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-97a8c721-7da2-452c-9f57-0cc07758c3c5 req-f531a91e-2d32-412a-99eb-c682fd04170a service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:56.043485 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-97a8c721-7da2-452c-9f57-0cc07758c3c5 req-f531a91e-2d32-412a-99eb-c682fd04170a service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:56.043983 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-97a8c721-7da2-452c-9f57-0cc07758c3c5 req-f531a91e-2d32-412a-99eb-c682fd04170a service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:56.058897 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-fa0e0863-6c7a-4a73-b1fb-0db3149cbf59 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:56.063198 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-97a8c721-7da2-452c-9f57-0cc07758c3c5 req-f531a91e-2d32-412a-99eb-c682fd04170a service nova] Creating event network-vif-plugged:068b5a44-602c-41f5-93ae-92aab177d2c9 for instance 3f737271-603e-4448-b37d-4a5ae83dd052 on hv-cinder-81558 Oct 18 11:42:56.075195 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-97a8c721-7da2-452c-9f57-0cc07758c3c5 req-f531a91e-2d32-412a-99eb-c682fd04170a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055445 Oct 18 11:42:56.075971 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 182/339] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:42:56.076124 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-fa0e0863-6c7a-4a73-b1fb-0db3149cbf59 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1367 microversion: 2.1 time: 0.238652 Oct 18 11:42:56.076678 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 158/340] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:55 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:56.263646 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-3a2ba2ca-4c9b-4760-90dd-d21d98d9c57d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:56.264343 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-3a2ba2ca-4c9b-4760-90dd-d21d98d9c57d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:56.270607 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3a2ba2ca-4c9b-4760-90dd-d21d98d9c57d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:56.271086 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3a2ba2ca-4c9b-4760-90dd-d21d98d9c57d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:56.271519 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3a2ba2ca-4c9b-4760-90dd-d21d98d9c57d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:56.272749 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3a2ba2ca-4c9b-4760-90dd-d21d98d9c57d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:56.273244 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3a2ba2ca-4c9b-4760-90dd-d21d98d9c57d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:56.273669 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3a2ba2ca-4c9b-4760-90dd-d21d98d9c57d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:56.448683 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-3a2ba2ca-4c9b-4760-90dd-d21d98d9c57d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:56.457449 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-3a2ba2ca-4c9b-4760-90dd-d21d98d9c57d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1370 microversion: 2.1 time: 0.198025 Oct 18 11:42:56.458176 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 183/341] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:56 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1370 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:56.562802 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-fd85b662-5b01-4b82-b5d2-a8cc1bacdc53 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:56.563694 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-fd85b662-5b01-4b82-b5d2-a8cc1bacdc53 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:56.571216 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fd85b662-5b01-4b82-b5d2-a8cc1bacdc53 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:56.571966 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fd85b662-5b01-4b82-b5d2-a8cc1bacdc53 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:56.572575 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fd85b662-5b01-4b82-b5d2-a8cc1bacdc53 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:56.573464 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fd85b662-5b01-4b82-b5d2-a8cc1bacdc53 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:56.574070 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fd85b662-5b01-4b82-b5d2-a8cc1bacdc53 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:56.574641 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fd85b662-5b01-4b82-b5d2-a8cc1bacdc53 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:56.713391 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-fd85b662-5b01-4b82-b5d2-a8cc1bacdc53 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:56.727373 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-fd85b662-5b01-4b82-b5d2-a8cc1bacdc53 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1358 microversion: 2.1 time: 0.168427 Oct 18 11:42:56.728004 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 159/342] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:56 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:57.100579 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-59201b6b-cc55-4f0d-8809-e2a02d262ab4 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:57.101360 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-59201b6b-cc55-4f0d-8809-e2a02d262ab4 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:57.107518 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-59201b6b-cc55-4f0d-8809-e2a02d262ab4 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:57.108007 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-59201b6b-cc55-4f0d-8809-e2a02d262ab4 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:57.108442 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-59201b6b-cc55-4f0d-8809-e2a02d262ab4 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:57.109243 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-59201b6b-cc55-4f0d-8809-e2a02d262ab4 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:57.109696 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-59201b6b-cc55-4f0d-8809-e2a02d262ab4 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:57.110116 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-59201b6b-cc55-4f0d-8809-e2a02d262ab4 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:57.271171 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-59201b6b-cc55-4f0d-8809-e2a02d262ab4 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:57.281756 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-59201b6b-cc55-4f0d-8809-e2a02d262ab4 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1367 microversion: 2.1 time: 0.185334 Oct 18 11:42:57.289750 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 184/343] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:57 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:57.483170 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-ecf38d55-f449-4e84-80fd-a668cce79460 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:57.483821 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-ecf38d55-f449-4e84-80fd-a668cce79460 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:57.490847 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ecf38d55-f449-4e84-80fd-a668cce79460 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:57.491337 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ecf38d55-f449-4e84-80fd-a668cce79460 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:57.491773 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ecf38d55-f449-4e84-80fd-a668cce79460 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:57.492476 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ecf38d55-f449-4e84-80fd-a668cce79460 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:57.492962 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ecf38d55-f449-4e84-80fd-a668cce79460 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:57.493391 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ecf38d55-f449-4e84-80fd-a668cce79460 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:57.634347 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-ecf38d55-f449-4e84-80fd-a668cce79460 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:57.639999 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell1:SELECT=100 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:42:57.647069 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-ecf38d55-f449-4e84-80fd-a668cce79460 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1370 microversion: 2.1 time: 0.168478 Oct 18 11:42:57.648326 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 160/344] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:57 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:57.751808 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-e5c0d920-6785-457d-bb4a-9811725aab53 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:57.752342 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-e5c0d920-6785-457d-bb4a-9811725aab53 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:57.759931 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e5c0d920-6785-457d-bb4a-9811725aab53 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:57.760428 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e5c0d920-6785-457d-bb4a-9811725aab53 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:57.761091 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e5c0d920-6785-457d-bb4a-9811725aab53 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:57.761959 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e5c0d920-6785-457d-bb4a-9811725aab53 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:57.762634 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e5c0d920-6785-457d-bb4a-9811725aab53 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:57.763230 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e5c0d920-6785-457d-bb4a-9811725aab53 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:57.913100 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-e5c0d920-6785-457d-bb4a-9811725aab53 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:57.927451 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-e5c0d920-6785-457d-bb4a-9811725aab53 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1358 microversion: 2.1 time: 0.179358 Oct 18 11:42:57.932800 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 185/345] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:57 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:58.304810 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-328616d4-edd8-44c4-a9eb-ebe1d3698f21 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:58.305362 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-328616d4-edd8-44c4-a9eb-ebe1d3698f21 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:58.311615 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-328616d4-edd8-44c4-a9eb-ebe1d3698f21 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:58.312098 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-328616d4-edd8-44c4-a9eb-ebe1d3698f21 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:58.312527 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-328616d4-edd8-44c4-a9eb-ebe1d3698f21 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:58.313232 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-328616d4-edd8-44c4-a9eb-ebe1d3698f21 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:58.313680 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-328616d4-edd8-44c4-a9eb-ebe1d3698f21 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:58.314095 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-328616d4-edd8-44c4-a9eb-ebe1d3698f21 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:58.459898 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-328616d4-edd8-44c4-a9eb-ebe1d3698f21 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:58.469330 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-328616d4-edd8-44c4-a9eb-ebe1d3698f21 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1367 microversion: 2.1 time: 0.168363 Oct 18 11:42:58.470263 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 161/346] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:58 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:58.670092 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-b2c22d56-8ab2-4b29-aa23-5b06925593a1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:58.670732 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-b2c22d56-8ab2-4b29-aa23-5b06925593a1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:58.677220 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b2c22d56-8ab2-4b29-aa23-5b06925593a1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:58.677710 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b2c22d56-8ab2-4b29-aa23-5b06925593a1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:58.678702 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b2c22d56-8ab2-4b29-aa23-5b06925593a1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:58.679396 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b2c22d56-8ab2-4b29-aa23-5b06925593a1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:58.679854 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b2c22d56-8ab2-4b29-aa23-5b06925593a1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:58.680271 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b2c22d56-8ab2-4b29-aa23-5b06925593a1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:58.815072 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-b2c22d56-8ab2-4b29-aa23-5b06925593a1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:58.822584 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-b2c22d56-8ab2-4b29-aa23-5b06925593a1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1370 microversion: 2.1 time: 0.156316 Oct 18 11:42:58.823140 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 186/347] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:58 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:58.955246 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-4b07cdf4-84d8-4574-abed-a5ec4dc7f284 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:58.955822 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-4b07cdf4-84d8-4574-abed-a5ec4dc7f284 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:58.965802 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4b07cdf4-84d8-4574-abed-a5ec4dc7f284 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:58.966291 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4b07cdf4-84d8-4574-abed-a5ec4dc7f284 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:58.966722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4b07cdf4-84d8-4574-abed-a5ec4dc7f284 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:58.967426 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4b07cdf4-84d8-4574-abed-a5ec4dc7f284 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:58.967875 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4b07cdf4-84d8-4574-abed-a5ec4dc7f284 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:58.968296 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4b07cdf4-84d8-4574-abed-a5ec4dc7f284 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:59.110666 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-4b07cdf4-84d8-4574-abed-a5ec4dc7f284 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:59.119167 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-4b07cdf4-84d8-4574-abed-a5ec4dc7f284 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1358 microversion: 2.1 time: 0.167819 Oct 18 11:42:59.119739 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 162/348] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:58 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:42:59.496154 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-6f5b7c59-f7c8-464e-9246-caa1c6de2390 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:59.496716 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-6f5b7c59-f7c8-464e-9246-caa1c6de2390 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:59.503077 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6f5b7c59-f7c8-464e-9246-caa1c6de2390 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:59.503851 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6f5b7c59-f7c8-464e-9246-caa1c6de2390 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:59.504319 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6f5b7c59-f7c8-464e-9246-caa1c6de2390 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:59.505073 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6f5b7c59-f7c8-464e-9246-caa1c6de2390 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:59.505525 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6f5b7c59-f7c8-464e-9246-caa1c6de2390 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:59.506464 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6f5b7c59-f7c8-464e-9246-caa1c6de2390 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:59.847579 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-65e2ff5f-a1a5-4863-8248-b30d074cb3c7 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:42:59.848658 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-65e2ff5f-a1a5-4863-8248-b30d074cb3c7 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:42:59.856662 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-65e2ff5f-a1a5-4863-8248-b30d074cb3c7 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:59.857174 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-65e2ff5f-a1a5-4863-8248-b30d074cb3c7 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:59.857723 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-65e2ff5f-a1a5-4863-8248-b30d074cb3c7 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:59.858594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-65e2ff5f-a1a5-4863-8248-b30d074cb3c7 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:42:59.859126 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-65e2ff5f-a1a5-4863-8248-b30d074cb3c7 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:42:59.859585 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-65e2ff5f-a1a5-4863-8248-b30d074cb3c7 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:42:59.889367 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-6f5b7c59-f7c8-464e-9246-caa1c6de2390 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:42:59.897384 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-6f5b7c59-f7c8-464e-9246-caa1c6de2390 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1367 microversion: 2.1 time: 0.405526 Oct 18 11:42:59.912614 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 187/349] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:59 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1367 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:00.012529 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-65e2ff5f-a1a5-4863-8248-b30d074cb3c7 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:00.021254 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-65e2ff5f-a1a5-4863-8248-b30d074cb3c7 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1370 microversion: 2.1 time: 0.179071 Oct 18 11:43:00.021930 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 163/350] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:42:59 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:43:00.141744 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-5a1962af-7961-473a-8ec9-d63679935b38 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:00.142356 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-5a1962af-7961-473a-8ec9-d63679935b38 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:00.148637 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5a1962af-7961-473a-8ec9-d63679935b38 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:00.149309 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5a1962af-7961-473a-8ec9-d63679935b38 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:00.149844 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5a1962af-7961-473a-8ec9-d63679935b38 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:00.150531 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5a1962af-7961-473a-8ec9-d63679935b38 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:00.151189 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5a1962af-7961-473a-8ec9-d63679935b38 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:00.151769 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5a1962af-7961-473a-8ec9-d63679935b38 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:00.291980 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-5a1962af-7961-473a-8ec9-d63679935b38 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:00.301874 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-5a1962af-7961-473a-8ec9-d63679935b38 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1358 microversion: 2.1 time: 0.163794 Oct 18 11:43:00.302750 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 188/351] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:00 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:00.920820 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-4cddaffa-9bc6-4de6-97a2-5aa19221db9f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:00.921529 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-4cddaffa-9bc6-4de6-97a2-5aa19221db9f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:00.928333 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4cddaffa-9bc6-4de6-97a2-5aa19221db9f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:00.929709 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4cddaffa-9bc6-4de6-97a2-5aa19221db9f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:00.930309 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4cddaffa-9bc6-4de6-97a2-5aa19221db9f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:00.931121 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4cddaffa-9bc6-4de6-97a2-5aa19221db9f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:00.931690 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4cddaffa-9bc6-4de6-97a2-5aa19221db9f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:00.932242 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4cddaffa-9bc6-4de6-97a2-5aa19221db9f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:01.045413 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-3db9f92c-29c8-4e40-8feb-626d29e59538 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:01.046309 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-3db9f92c-29c8-4e40-8feb-626d29e59538 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:01.054147 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3db9f92c-29c8-4e40-8feb-626d29e59538 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:01.054753 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3db9f92c-29c8-4e40-8feb-626d29e59538 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:01.055262 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3db9f92c-29c8-4e40-8feb-626d29e59538 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:01.056031 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3db9f92c-29c8-4e40-8feb-626d29e59538 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:01.056578 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3db9f92c-29c8-4e40-8feb-626d29e59538 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:01.057322 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3db9f92c-29c8-4e40-8feb-626d29e59538 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:01.298841 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-3db9f92c-29c8-4e40-8feb-626d29e59538 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:01.309672 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-3db9f92c-29c8-4e40-8feb-626d29e59538 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1370 microversion: 2.1 time: 0.268378 Oct 18 11:43:01.310277 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 189/352] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:01 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1370 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:01.330655 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-968c59ec-8ff0-4b70-aae3-704bdb9ab7ca tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:01.331357 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-968c59ec-8ff0-4b70-aae3-704bdb9ab7ca tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:01.338770 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-968c59ec-8ff0-4b70-aae3-704bdb9ab7ca tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:01.339539 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-968c59ec-8ff0-4b70-aae3-704bdb9ab7ca tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:01.340237 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-968c59ec-8ff0-4b70-aae3-704bdb9ab7ca tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:01.341345 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-968c59ec-8ff0-4b70-aae3-704bdb9ab7ca tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:01.345239 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-968c59ec-8ff0-4b70-aae3-704bdb9ab7ca tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:01.345708 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-968c59ec-8ff0-4b70-aae3-704bdb9ab7ca tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:01.561699 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-968c59ec-8ff0-4b70-aae3-704bdb9ab7ca tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:01.569635 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-968c59ec-8ff0-4b70-aae3-704bdb9ab7ca tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1358 microversion: 2.1 time: 0.243356 Oct 18 11:43:01.570108 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-4cddaffa-9bc6-4de6-97a2-5aa19221db9f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:01.578962 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-4cddaffa-9bc6-4de6-97a2-5aa19221db9f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1367 microversion: 2.1 time: 0.663213 Oct 18 11:43:01.580232 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 164/353] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:00 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1367 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:01.589042 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 190/354] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:01 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1358 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:02.332369 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-0c7c575e-8851-47ab-a13c-91b2753b37c9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:02.333013 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-0c7c575e-8851-47ab-a13c-91b2753b37c9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:02.339869 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0c7c575e-8851-47ab-a13c-91b2753b37c9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:02.340350 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0c7c575e-8851-47ab-a13c-91b2753b37c9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:02.340769 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0c7c575e-8851-47ab-a13c-91b2753b37c9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:02.341508 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0c7c575e-8851-47ab-a13c-91b2753b37c9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:02.341951 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0c7c575e-8851-47ab-a13c-91b2753b37c9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:02.342925 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0c7c575e-8851-47ab-a13c-91b2753b37c9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:02.596562 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-404446f3-4e76-4e8a-8175-fc018fdcb135 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:02.597999 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-404446f3-4e76-4e8a-8175-fc018fdcb135 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:02.603041 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:43:02.607136 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-404446f3-4e76-4e8a-8175-fc018fdcb135 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:02.607628 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-404446f3-4e76-4e8a-8175-fc018fdcb135 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:02.608062 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-404446f3-4e76-4e8a-8175-fc018fdcb135 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:02.608765 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-404446f3-4e76-4e8a-8175-fc018fdcb135 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:02.609287 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-404446f3-4e76-4e8a-8175-fc018fdcb135 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:02.609706 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-404446f3-4e76-4e8a-8175-fc018fdcb135 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:02.634315 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-0c7c575e-8851-47ab-a13c-91b2753b37c9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:02.657927 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-0c7c575e-8851-47ab-a13c-91b2753b37c9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1370 microversion: 2.1 time: 0.317059 Oct 18 11:43:02.660339 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 165/355] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:02 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1370 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:02.666149 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-c3f20d2e-fdff-4500-937d-b60802ae91b4 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:02.666761 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-c3f20d2e-fdff-4500-937d-b60802ae91b4 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:02.679431 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c3f20d2e-fdff-4500-937d-b60802ae91b4 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:02.680047 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c3f20d2e-fdff-4500-937d-b60802ae91b4 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:02.680487 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c3f20d2e-fdff-4500-937d-b60802ae91b4 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:02.681225 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c3f20d2e-fdff-4500-937d-b60802ae91b4 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:02.681681 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c3f20d2e-fdff-4500-937d-b60802ae91b4 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:02.682102 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c3f20d2e-fdff-4500-937d-b60802ae91b4 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:02.776178 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-404446f3-4e76-4e8a-8175-fc018fdcb135 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:02.785706 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-404446f3-4e76-4e8a-8175-fc018fdcb135 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1358 microversion: 2.1 time: 0.193181 Oct 18 11:43:02.786424 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 191/356] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:02 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:43:02.841881 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-c3f20d2e-fdff-4500-937d-b60802ae91b4 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:02.851965 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-c3f20d2e-fdff-4500-937d-b60802ae91b4 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1367 microversion: 2.1 time: 0.190229 Oct 18 11:43:02.852574 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 166/357] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:02 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:03.685129 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-5e45bedc-a1e4-44af-a181-7147fe71bc97 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:03.685746 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-5e45bedc-a1e4-44af-a181-7147fe71bc97 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:03.693848 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5e45bedc-a1e4-44af-a181-7147fe71bc97 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:03.694470 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5e45bedc-a1e4-44af-a181-7147fe71bc97 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:03.694926 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5e45bedc-a1e4-44af-a181-7147fe71bc97 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:03.695632 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5e45bedc-a1e4-44af-a181-7147fe71bc97 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:03.696111 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5e45bedc-a1e4-44af-a181-7147fe71bc97 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:03.696556 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5e45bedc-a1e4-44af-a181-7147fe71bc97 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:03.812597 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-01b2e293-f29b-441d-947a-86519f18a0e7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:03.813332 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-01b2e293-f29b-441d-947a-86519f18a0e7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:03.820395 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-01b2e293-f29b-441d-947a-86519f18a0e7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:03.821129 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-01b2e293-f29b-441d-947a-86519f18a0e7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:03.821509 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-01b2e293-f29b-441d-947a-86519f18a0e7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:03.822206 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-01b2e293-f29b-441d-947a-86519f18a0e7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:03.822852 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-01b2e293-f29b-441d-947a-86519f18a0e7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:03.823278 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-01b2e293-f29b-441d-947a-86519f18a0e7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:03.845964 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-5e45bedc-a1e4-44af-a181-7147fe71bc97 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:03.854780 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-5e45bedc-a1e4-44af-a181-7147fe71bc97 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1370 microversion: 2.1 time: 0.174827 Oct 18 11:43:03.855929 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 192/358] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:03 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:03.879146 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-d55cd63d-0f46-4c54-8210-4f7bd3e0b3e5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:03.879769 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-d55cd63d-0f46-4c54-8210-4f7bd3e0b3e5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:03.893709 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d55cd63d-0f46-4c54-8210-4f7bd3e0b3e5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:03.894959 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d55cd63d-0f46-4c54-8210-4f7bd3e0b3e5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:03.896217 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d55cd63d-0f46-4c54-8210-4f7bd3e0b3e5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:03.899566 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d55cd63d-0f46-4c54-8210-4f7bd3e0b3e5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:03.901002 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d55cd63d-0f46-4c54-8210-4f7bd3e0b3e5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:03.902238 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d55cd63d-0f46-4c54-8210-4f7bd3e0b3e5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:04.007372 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-01b2e293-f29b-441d-947a-86519f18a0e7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:04.017085 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-01b2e293-f29b-441d-947a-86519f18a0e7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1358 microversion: 2.1 time: 0.209182 Oct 18 11:43:04.018274 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 167/359] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:03 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:43:04.066999 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-d55cd63d-0f46-4c54-8210-4f7bd3e0b3e5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:04.076942 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-d55cd63d-0f46-4c54-8210-4f7bd3e0b3e5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1367 microversion: 2.1 time: 0.203195 Oct 18 11:43:04.077543 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 193/360] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:03 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:04.880125 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-a4186015-6413-4d66-b57d-7e79b32eeb16 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:04.880763 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-a4186015-6413-4d66-b57d-7e79b32eeb16 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:04.886855 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a4186015-6413-4d66-b57d-7e79b32eeb16 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:04.887337 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a4186015-6413-4d66-b57d-7e79b32eeb16 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:04.887768 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a4186015-6413-4d66-b57d-7e79b32eeb16 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:04.888453 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a4186015-6413-4d66-b57d-7e79b32eeb16 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:04.888932 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a4186015-6413-4d66-b57d-7e79b32eeb16 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:04.889360 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a4186015-6413-4d66-b57d-7e79b32eeb16 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:05.040788 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-89dbcd15-89c3-4f23-947a-1c0c1ff82323 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:05.041469 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-89dbcd15-89c3-4f23-947a-1c0c1ff82323 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:05.048376 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-89dbcd15-89c3-4f23-947a-1c0c1ff82323 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:05.049094 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-89dbcd15-89c3-4f23-947a-1c0c1ff82323 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:05.049689 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-89dbcd15-89c3-4f23-947a-1c0c1ff82323 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:05.050417 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-89dbcd15-89c3-4f23-947a-1c0c1ff82323 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:05.050860 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-89dbcd15-89c3-4f23-947a-1c0c1ff82323 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:05.051659 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-89dbcd15-89c3-4f23-947a-1c0c1ff82323 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:05.052180 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-a4186015-6413-4d66-b57d-7e79b32eeb16 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:05.061470 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-a4186015-6413-4d66-b57d-7e79b32eeb16 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1564 microversion: 2.1 time: 0.185155 Oct 18 11:43:05.062321 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 168/361] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:04 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1564 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:05.073427 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=100 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:43:05.087733 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-cba10790-59ef-43b8-9063-8a66bc98289f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:05.088274 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-cba10790-59ef-43b8-9063-8a66bc98289f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:05.093540 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:43:05.097385 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cba10790-59ef-43b8-9063-8a66bc98289f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:05.098149 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cba10790-59ef-43b8-9063-8a66bc98289f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:05.098933 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cba10790-59ef-43b8-9063-8a66bc98289f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:05.100549 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cba10790-59ef-43b8-9063-8a66bc98289f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:05.101194 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cba10790-59ef-43b8-9063-8a66bc98289f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:05.101772 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cba10790-59ef-43b8-9063-8a66bc98289f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:05.189373 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-cba10790-59ef-43b8-9063-8a66bc98289f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106804 Oct 18 11:43:05.190016 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 169/362] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Oct 18 11:43:05 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:43:05.196567 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-4b42d916-df7c-40a7-b6f2-5f5684e5fc86 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:05.197214 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-4b42d916-df7c-40a7-b6f2-5f5684e5fc86 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:05.200587 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-89dbcd15-89c3-4f23-947a-1c0c1ff82323 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:05.203523 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4b42d916-df7c-40a7-b6f2-5f5684e5fc86 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:05.204024 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4b42d916-df7c-40a7-b6f2-5f5684e5fc86 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:05.204461 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4b42d916-df7c-40a7-b6f2-5f5684e5fc86 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:05.205187 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4b42d916-df7c-40a7-b6f2-5f5684e5fc86 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:05.205641 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4b42d916-df7c-40a7-b6f2-5f5684e5fc86 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:05.206068 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4b42d916-df7c-40a7-b6f2-5f5684e5fc86 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:05.210351 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-89dbcd15-89c3-4f23-947a-1c0c1ff82323 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1358 microversion: 2.1 time: 0.173929 Oct 18 11:43:05.210928 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 194/363] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:05 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:43:05.216583 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-941802aa-72db-46dd-9b5c-06bb2c88e8fe tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:05.217655 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-941802aa-72db-46dd-9b5c-06bb2c88e8fe tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:05.223661 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-941802aa-72db-46dd-9b5c-06bb2c88e8fe tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:05.224396 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-941802aa-72db-46dd-9b5c-06bb2c88e8fe tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:05.226114 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-941802aa-72db-46dd-9b5c-06bb2c88e8fe tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:05.227007 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-941802aa-72db-46dd-9b5c-06bb2c88e8fe tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:05.227472 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-941802aa-72db-46dd-9b5c-06bb2c88e8fe tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:05.227890 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-941802aa-72db-46dd-9b5c-06bb2c88e8fe tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:05.252873 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-941802aa-72db-46dd-9b5c-06bb2c88e8fe tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d/ips" status: 200 len: 151 microversion: 2.20 time: 0.039813 Oct 18 11:43:05.253624 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 195/364] 10.222.0.17 () {60 vars in 1289 bytes} [Tue Oct 18 11:43:05 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 11:43:05.487969 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-4b42d916-df7c-40a7-b6f2-5f5684e5fc86 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:05.492322 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-4b42d916-df7c-40a7-b6f2-5f5684e5fc86 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1367 microversion: 2.1 time: 0.300096 Oct 18 11:43:05.492921 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 170/365] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:05 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:06.233938 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-0324ec33-580d-44c6-b1fb-f5feb484a2f8 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:06.234473 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-0324ec33-580d-44c6-b1fb-f5feb484a2f8 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:06.240799 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0324ec33-580d-44c6-b1fb-f5feb484a2f8 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:06.241304 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0324ec33-580d-44c6-b1fb-f5feb484a2f8 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:06.241734 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0324ec33-580d-44c6-b1fb-f5feb484a2f8 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:06.242426 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0324ec33-580d-44c6-b1fb-f5feb484a2f8 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:06.242872 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0324ec33-580d-44c6-b1fb-f5feb484a2f8 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:06.243288 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0324ec33-580d-44c6-b1fb-f5feb484a2f8 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:06.338019 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-5a513bdf-d805-47c1-a7bb-358a7709bc33 req-307509da-ba0c-4600-aaa2-3e12b3402cb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f737271-603e-4448-b37d-4a5ae83dd052", "tag": "068b5a44-602c-41f5-93ae-92aab177d2c9"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:43:06.349237 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-5a513bdf-d805-47c1-a7bb-358a7709bc33 req-307509da-ba0c-4600-aaa2-3e12b3402cb8 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:06.349756 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-5a513bdf-d805-47c1-a7bb-358a7709bc33 req-307509da-ba0c-4600-aaa2-3e12b3402cb8 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:06.350182 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-5a513bdf-d805-47c1-a7bb-358a7709bc33 req-307509da-ba0c-4600-aaa2-3e12b3402cb8 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:06.361823 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-5a513bdf-d805-47c1-a7bb-358a7709bc33 req-307509da-ba0c-4600-aaa2-3e12b3402cb8 service nova] Creating event network-changed:068b5a44-602c-41f5-93ae-92aab177d2c9 for instance 3f737271-603e-4448-b37d-4a5ae83dd052 on hv-cinder-81558 Oct 18 11:43:06.366915 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-5a513bdf-d805-47c1-a7bb-358a7709bc33 req-307509da-ba0c-4600-aaa2-3e12b3402cb8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033554 Oct 18 11:43:06.367836 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 171/366] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:43:06.381779 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-0324ec33-580d-44c6-b1fb-f5feb484a2f8 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:06.389632 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-0324ec33-580d-44c6-b1fb-f5feb484a2f8 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1358 microversion: 2.1 time: 0.159566 Oct 18 11:43:06.390195 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 196/367] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:06 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:06.517628 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-2c4eb33e-7e1e-42e9-bbd3-e55ab9853a6e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:06.518576 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-2c4eb33e-7e1e-42e9-bbd3-e55ab9853a6e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:06.557082 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2c4eb33e-7e1e-42e9-bbd3-e55ab9853a6e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:06.558172 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2c4eb33e-7e1e-42e9-bbd3-e55ab9853a6e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:06.559011 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2c4eb33e-7e1e-42e9-bbd3-e55ab9853a6e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:06.560031 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2c4eb33e-7e1e-42e9-bbd3-e55ab9853a6e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:06.560774 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2c4eb33e-7e1e-42e9-bbd3-e55ab9853a6e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:06.561429 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2c4eb33e-7e1e-42e9-bbd3-e55ab9853a6e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:06.713210 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-2c4eb33e-7e1e-42e9-bbd3-e55ab9853a6e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:06.722030 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-2c4eb33e-7e1e-42e9-bbd3-e55ab9853a6e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1367 microversion: 2.1 time: 0.209679 Oct 18 11:43:06.722610 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 172/368] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:06 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:07.413564 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-e3ad4642-3b29-4eb6-b842-35cac55080e8 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:07.414255 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-e3ad4642-3b29-4eb6-b842-35cac55080e8 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:07.420992 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e3ad4642-3b29-4eb6-b842-35cac55080e8 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:07.421579 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e3ad4642-3b29-4eb6-b842-35cac55080e8 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:07.422083 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e3ad4642-3b29-4eb6-b842-35cac55080e8 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:07.422875 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e3ad4642-3b29-4eb6-b842-35cac55080e8 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:07.423402 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e3ad4642-3b29-4eb6-b842-35cac55080e8 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:07.423899 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e3ad4642-3b29-4eb6-b842-35cac55080e8 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:07.581443 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-e3ad4642-3b29-4eb6-b842-35cac55080e8 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:07.590200 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-e3ad4642-3b29-4eb6-b842-35cac55080e8 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1358 microversion: 2.1 time: 0.181200 Oct 18 11:43:07.601271 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 197/369] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:07 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:43:07.746110 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-9e65eeff-7ac5-42bd-bafd-e99e8ee9d56c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:07.746748 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-9e65eeff-7ac5-42bd-bafd-e99e8ee9d56c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:07.753110 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9e65eeff-7ac5-42bd-bafd-e99e8ee9d56c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:07.753587 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9e65eeff-7ac5-42bd-bafd-e99e8ee9d56c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:07.754013 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9e65eeff-7ac5-42bd-bafd-e99e8ee9d56c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:07.754691 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9e65eeff-7ac5-42bd-bafd-e99e8ee9d56c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:07.755142 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9e65eeff-7ac5-42bd-bafd-e99e8ee9d56c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:07.755556 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9e65eeff-7ac5-42bd-bafd-e99e8ee9d56c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:08.130738 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-9e65eeff-7ac5-42bd-bafd-e99e8ee9d56c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:08.138849 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-9e65eeff-7ac5-42bd-bafd-e99e8ee9d56c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1367 microversion: 2.1 time: 0.396673 Oct 18 11:43:08.139408 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 173/370] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:07 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1367 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:08.426621 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-618b26c9-af5a-4a4f-9f48-e940276ba526 req-786261c1-839b-46b0-8c91-7df0057ec06f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fc6ee0a-b135-42dc-9099-30672626af2e", "name": "network-vif-plugged", "status": "completed", "tag": "dad12b9b-8fc3-457f-a59d-d7e7760984cc"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:43:08.436813 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-618b26c9-af5a-4a4f-9f48-e940276ba526 req-786261c1-839b-46b0-8c91-7df0057ec06f service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:08.437317 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-618b26c9-af5a-4a4f-9f48-e940276ba526 req-786261c1-839b-46b0-8c91-7df0057ec06f service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:08.437745 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-618b26c9-af5a-4a4f-9f48-e940276ba526 req-786261c1-839b-46b0-8c91-7df0057ec06f service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:08.450105 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-618b26c9-af5a-4a4f-9f48-e940276ba526 req-786261c1-839b-46b0-8c91-7df0057ec06f service nova] Creating event network-vif-plugged:dad12b9b-8fc3-457f-a59d-d7e7760984cc for instance 0fc6ee0a-b135-42dc-9099-30672626af2e on hv-cinder-81558 Oct 18 11:43:08.454993 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-618b26c9-af5a-4a4f-9f48-e940276ba526 req-786261c1-839b-46b0-8c91-7df0057ec06f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032136 Oct 18 11:43:08.455743 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 198/371] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:43:08.613046 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-3ffd40b1-4e2b-49eb-9d8b-970bd6ef4f43 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:08.613656 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-3ffd40b1-4e2b-49eb-9d8b-970bd6ef4f43 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:08.619943 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3ffd40b1-4e2b-49eb-9d8b-970bd6ef4f43 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:08.620418 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3ffd40b1-4e2b-49eb-9d8b-970bd6ef4f43 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:08.620860 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3ffd40b1-4e2b-49eb-9d8b-970bd6ef4f43 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:08.621602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3ffd40b1-4e2b-49eb-9d8b-970bd6ef4f43 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:08.622052 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3ffd40b1-4e2b-49eb-9d8b-970bd6ef4f43 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:08.622469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3ffd40b1-4e2b-49eb-9d8b-970bd6ef4f43 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:08.750543 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-3ffd40b1-4e2b-49eb-9d8b-970bd6ef4f43 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:08.759332 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-3ffd40b1-4e2b-49eb-9d8b-970bd6ef4f43 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1358 microversion: 2.1 time: 0.150191 Oct 18 11:43:08.759898 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 174/372] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:08 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:09.162841 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-aee0180d-4d2d-4ed1-b246-53887504f374 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:09.163541 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-aee0180d-4d2d-4ed1-b246-53887504f374 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:09.170085 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-aee0180d-4d2d-4ed1-b246-53887504f374 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:09.170574 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-aee0180d-4d2d-4ed1-b246-53887504f374 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:09.171003 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-aee0180d-4d2d-4ed1-b246-53887504f374 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:09.171710 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-aee0180d-4d2d-4ed1-b246-53887504f374 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:09.172186 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-aee0180d-4d2d-4ed1-b246-53887504f374 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:09.172602 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-aee0180d-4d2d-4ed1-b246-53887504f374 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:09.323932 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-aee0180d-4d2d-4ed1-b246-53887504f374 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:09.332364 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-aee0180d-4d2d-4ed1-b246-53887504f374 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1367 microversion: 2.1 time: 0.173815 Oct 18 11:43:09.335211 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 199/373] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:09 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:09.780796 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-892c3178-f931-4f0b-933f-754c57bca96e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:09.782322 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-892c3178-f931-4f0b-933f-754c57bca96e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:09.789292 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-892c3178-f931-4f0b-933f-754c57bca96e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:09.789773 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-892c3178-f931-4f0b-933f-754c57bca96e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:09.790201 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-892c3178-f931-4f0b-933f-754c57bca96e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:09.791127 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-892c3178-f931-4f0b-933f-754c57bca96e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:09.791468 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-892c3178-f931-4f0b-933f-754c57bca96e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:09.791888 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-892c3178-f931-4f0b-933f-754c57bca96e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:09.949924 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-892c3178-f931-4f0b-933f-754c57bca96e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:09.957864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-892c3178-f931-4f0b-933f-754c57bca96e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1358 microversion: 2.1 time: 0.180871 Oct 18 11:43:09.958439 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 175/374] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:09 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:10.356786 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-490031ea-67ef-4e91-94ec-ee8e511fd040 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:10.357452 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-490031ea-67ef-4e91-94ec-ee8e511fd040 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:10.363881 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-490031ea-67ef-4e91-94ec-ee8e511fd040 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:10.364359 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-490031ea-67ef-4e91-94ec-ee8e511fd040 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:10.364789 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-490031ea-67ef-4e91-94ec-ee8e511fd040 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:10.365495 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-490031ea-67ef-4e91-94ec-ee8e511fd040 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:10.365944 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-490031ea-67ef-4e91-94ec-ee8e511fd040 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:10.366365 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-490031ea-67ef-4e91-94ec-ee8e511fd040 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:10.496727 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-490031ea-67ef-4e91-94ec-ee8e511fd040 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:10.504746 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-490031ea-67ef-4e91-94ec-ee8e511fd040 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1367 microversion: 2.1 time: 0.151799 Oct 18 11:43:10.505344 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 200/375] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:10 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:10.981143 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-fc2f5fa7-1324-4b37-9546-99ef5f0fbc21 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:10.981749 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-fc2f5fa7-1324-4b37-9546-99ef5f0fbc21 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:10.988089 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fc2f5fa7-1324-4b37-9546-99ef5f0fbc21 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:10.988747 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fc2f5fa7-1324-4b37-9546-99ef5f0fbc21 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:10.989216 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fc2f5fa7-1324-4b37-9546-99ef5f0fbc21 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:10.989893 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fc2f5fa7-1324-4b37-9546-99ef5f0fbc21 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:10.990840 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fc2f5fa7-1324-4b37-9546-99ef5f0fbc21 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:10.991250 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fc2f5fa7-1324-4b37-9546-99ef5f0fbc21 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:11.121337 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-fc2f5fa7-1324-4b37-9546-99ef5f0fbc21 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:11.128986 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-fc2f5fa7-1324-4b37-9546-99ef5f0fbc21 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1358 microversion: 2.1 time: 0.151990 Oct 18 11:43:11.129550 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 176/376] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:10 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:11.374414 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-40077870-e96a-4c39-a63d-3e657201a748 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:43:11.374952 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-40077870-e96a-4c39-a63d-3e657201a748 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:11.381410 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-40077870-e96a-4c39-a63d-3e657201a748 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:11.381893 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-40077870-e96a-4c39-a63d-3e657201a748 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:11.382324 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-40077870-e96a-4c39-a63d-3e657201a748 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:11.383010 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-40077870-e96a-4c39-a63d-3e657201a748 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:11.383464 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-40077870-e96a-4c39-a63d-3e657201a748 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:11.383886 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-40077870-e96a-4c39-a63d-3e657201a748 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:11.405809 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.objects.instance [None req-40077870-e96a-4c39-a63d-3e657201a748 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lazy-loading 'flavor' on Instance uuid a2b9dfa2-7553-47cd-8274-6a0004bac79d {{(pid=125485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:43:11.527921 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-12aae477-0ba4-4ca9-9717-fee5ace93c5e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:11.528526 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-12aae477-0ba4-4ca9-9717-fee5ace93c5e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:11.534912 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-12aae477-0ba4-4ca9-9717-fee5ace93c5e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:11.535472 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-12aae477-0ba4-4ca9-9717-fee5ace93c5e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:11.536166 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-12aae477-0ba4-4ca9-9717-fee5ace93c5e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:11.536776 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-12aae477-0ba4-4ca9-9717-fee5ace93c5e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:11.537765 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-12aae477-0ba4-4ca9-9717-fee5ace93c5e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:11.538178 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-12aae477-0ba4-4ca9-9717-fee5ace93c5e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:11.637714 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-40077870-e96a-4c39-a63d-3e657201a748 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "POST /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d/action" status: 202 len: 0 microversion: 2.20 time: 0.267002 Oct 18 11:43:11.638308 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 201/377] 10.222.0.17 () {62 vars in 1319 bytes} [Tue Oct 18 11:43:11 2022] POST /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 11:43:11.646685 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-f259b680-3099-45cb-bece-3c05d31cfe78 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:11.647381 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-f259b680-3099-45cb-bece-3c05d31cfe78 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:11.653813 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f259b680-3099-45cb-bece-3c05d31cfe78 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:11.654291 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f259b680-3099-45cb-bece-3c05d31cfe78 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:11.654721 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f259b680-3099-45cb-bece-3c05d31cfe78 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:11.655418 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f259b680-3099-45cb-bece-3c05d31cfe78 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:11.655866 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f259b680-3099-45cb-bece-3c05d31cfe78 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:11.656281 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f259b680-3099-45cb-bece-3c05d31cfe78 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:11.681241 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-12aae477-0ba4-4ca9-9717-fee5ace93c5e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:11.688898 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-12aae477-0ba4-4ca9-9717-fee5ace93c5e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1367 microversion: 2.1 time: 0.165224 Oct 18 11:43:11.691041 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 177/378] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:11 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:43:11.789166 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-f259b680-3099-45cb-bece-3c05d31cfe78 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:11.797150 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-f259b680-3099-45cb-bece-3c05d31cfe78 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:11.798589 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-f259b680-3099-45cb-bece-3c05d31cfe78 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:11.799748 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-f259b680-3099-45cb-bece-3c05d31cfe78 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1722 microversion: 2.20 time: 0.157106 Oct 18 11:43:11.800296 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 202/379] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:11 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:43:12.152482 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-7748cb3d-ee8f-4e7a-af88-0a361b1c084c tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:12.153041 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-7748cb3d-ee8f-4e7a-af88-0a361b1c084c tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:12.159830 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7748cb3d-ee8f-4e7a-af88-0a361b1c084c tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:12.160307 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7748cb3d-ee8f-4e7a-af88-0a361b1c084c tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:12.160731 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7748cb3d-ee8f-4e7a-af88-0a361b1c084c tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:12.161443 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7748cb3d-ee8f-4e7a-af88-0a361b1c084c tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:12.162455 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7748cb3d-ee8f-4e7a-af88-0a361b1c084c tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:12.162882 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7748cb3d-ee8f-4e7a-af88-0a361b1c084c tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:12.182742 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell1:SELECT=100 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:43:12.293366 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-7748cb3d-ee8f-4e7a-af88-0a361b1c084c tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:12.301046 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-7748cb3d-ee8f-4e7a-af88-0a361b1c084c tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1358 microversion: 2.1 time: 0.152761 Oct 18 11:43:12.301611 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 178/380] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:12 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:12.713911 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-3e256993-a733-4e28-85c1-9b2b610c94cb tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:12.714506 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-3e256993-a733-4e28-85c1-9b2b610c94cb tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:12.720950 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3e256993-a733-4e28-85c1-9b2b610c94cb tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:12.721367 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3e256993-a733-4e28-85c1-9b2b610c94cb tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:12.721796 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3e256993-a733-4e28-85c1-9b2b610c94cb tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:12.722489 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3e256993-a733-4e28-85c1-9b2b610c94cb tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:12.722929 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3e256993-a733-4e28-85c1-9b2b610c94cb tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:12.723346 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3e256993-a733-4e28-85c1-9b2b610c94cb tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:12.825187 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-fa20eabb-0b46-41ed-a9c5-5414c4cc12fd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:12.825790 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-fa20eabb-0b46-41ed-a9c5-5414c4cc12fd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:12.831640 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fa20eabb-0b46-41ed-a9c5-5414c4cc12fd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:12.832119 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fa20eabb-0b46-41ed-a9c5-5414c4cc12fd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:12.832547 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fa20eabb-0b46-41ed-a9c5-5414c4cc12fd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:12.833263 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fa20eabb-0b46-41ed-a9c5-5414c4cc12fd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:12.834282 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fa20eabb-0b46-41ed-a9c5-5414c4cc12fd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:12.834716 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fa20eabb-0b46-41ed-a9c5-5414c4cc12fd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:12.855676 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-3e256993-a733-4e28-85c1-9b2b610c94cb tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:12.863162 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-3e256993-a733-4e28-85c1-9b2b610c94cb tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1367 microversion: 2.1 time: 0.153394 Oct 18 11:43:12.863718 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 203/381] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:12 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:12.967933 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-fa20eabb-0b46-41ed-a9c5-5414c4cc12fd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:12.975950 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-fa20eabb-0b46-41ed-a9c5-5414c4cc12fd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:12.977344 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-fa20eabb-0b46-41ed-a9c5-5414c4cc12fd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:12.978484 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-fa20eabb-0b46-41ed-a9c5-5414c4cc12fd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1722 microversion: 2.20 time: 0.157263 Oct 18 11:43:12.979032 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 179/382] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:12 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:43:13.324964 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-3edc22dc-6ab8-4445-ad5d-17fd57fa5e60 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:13.325497 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-3edc22dc-6ab8-4445-ad5d-17fd57fa5e60 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:13.331413 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3edc22dc-6ab8-4445-ad5d-17fd57fa5e60 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:13.331890 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3edc22dc-6ab8-4445-ad5d-17fd57fa5e60 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:13.332319 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3edc22dc-6ab8-4445-ad5d-17fd57fa5e60 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:13.333031 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3edc22dc-6ab8-4445-ad5d-17fd57fa5e60 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:13.333479 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3edc22dc-6ab8-4445-ad5d-17fd57fa5e60 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:13.333899 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3edc22dc-6ab8-4445-ad5d-17fd57fa5e60 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:13.464336 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-3edc22dc-6ab8-4445-ad5d-17fd57fa5e60 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:13.471811 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-3edc22dc-6ab8-4445-ad5d-17fd57fa5e60 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1358 microversion: 2.1 time: 0.151044 Oct 18 11:43:13.472360 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 204/383] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:13 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:13.806009 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-e27a360e-5faf-4cc6-8827-ad3629d86320 req-556223bf-fb62-4771-a501-875eee978861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ea63cc8-527d-46ea-b6ef-d778dadb8ec5", "name": "network-vif-plugged", "status": "completed", "tag": "c6da8082-87ec-4172-bf6f-d60ef1511c4e"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:43:13.816241 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-e27a360e-5faf-4cc6-8827-ad3629d86320 req-556223bf-fb62-4771-a501-875eee978861 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:13.816782 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-e27a360e-5faf-4cc6-8827-ad3629d86320 req-556223bf-fb62-4771-a501-875eee978861 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:13.817345 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-e27a360e-5faf-4cc6-8827-ad3629d86320 req-556223bf-fb62-4771-a501-875eee978861 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:13.829916 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-e27a360e-5faf-4cc6-8827-ad3629d86320 req-556223bf-fb62-4771-a501-875eee978861 service nova] Creating event network-vif-plugged:c6da8082-87ec-4172-bf6f-d60ef1511c4e for instance 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 on hv-cinder-81558 Oct 18 11:43:13.835287 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-e27a360e-5faf-4cc6-8827-ad3629d86320 req-556223bf-fb62-4771-a501-875eee978861 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033514 Oct 18 11:43:13.835899 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 180/384] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:43:13.886897 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-e4611414-d971-4db8-805e-58ae88632b86 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:13.887604 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-e4611414-d971-4db8-805e-58ae88632b86 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:13.893833 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e4611414-d971-4db8-805e-58ae88632b86 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:13.894317 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e4611414-d971-4db8-805e-58ae88632b86 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:13.894749 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e4611414-d971-4db8-805e-58ae88632b86 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:13.895435 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e4611414-d971-4db8-805e-58ae88632b86 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:13.895883 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e4611414-d971-4db8-805e-58ae88632b86 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:13.896892 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e4611414-d971-4db8-805e-58ae88632b86 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:14.004638 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-c1eba060-dcb3-43a7-b7b9-1b434bfa5d15 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:14.005396 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-c1eba060-dcb3-43a7-b7b9-1b434bfa5d15 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:14.013164 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c1eba060-dcb3-43a7-b7b9-1b434bfa5d15 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:14.013660 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c1eba060-dcb3-43a7-b7b9-1b434bfa5d15 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:14.014172 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c1eba060-dcb3-43a7-b7b9-1b434bfa5d15 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:14.014880 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c1eba060-dcb3-43a7-b7b9-1b434bfa5d15 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:14.015336 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c1eba060-dcb3-43a7-b7b9-1b434bfa5d15 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:14.015760 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c1eba060-dcb3-43a7-b7b9-1b434bfa5d15 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:14.043340 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-e4611414-d971-4db8-805e-58ae88632b86 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:14.053300 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-e4611414-d971-4db8-805e-58ae88632b86 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1367 microversion: 2.1 time: 0.169480 Oct 18 11:43:14.053914 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 205/385] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:13 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:14.199622 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-c1eba060-dcb3-43a7-b7b9-1b434bfa5d15 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:14.208050 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-c1eba060-dcb3-43a7-b7b9-1b434bfa5d15 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:14.209651 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-c1eba060-dcb3-43a7-b7b9-1b434bfa5d15 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:14.212196 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-c1eba060-dcb3-43a7-b7b9-1b434bfa5d15 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1722 microversion: 2.20 time: 0.212019 Oct 18 11:43:14.212944 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 181/386] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:13 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:43:14.484757 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-90b723b7-3dcf-487d-83bf-a039851b9c86 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1474622436", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-910036943", "security_groups": [{"name": "tempest-secgroup-smoke-955799500"}], "networks": [{"uuid": "5e442a98-2910-4a15-af47-032a445d42de"}], "block_device_mapping_v2": [{"uuid": "47567028-6de9-4f1a-ad20-4363b4d5fae1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:43:14.494881 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-eb82b87c-6706-4ec8-a257-b82f98c22cf9 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:14.495488 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-eb82b87c-6706-4ec8-a257-b82f98c22cf9 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:14.501287 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-eb82b87c-6706-4ec8-a257-b82f98c22cf9 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:14.501791 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-eb82b87c-6706-4ec8-a257-b82f98c22cf9 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:14.502218 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-eb82b87c-6706-4ec8-a257-b82f98c22cf9 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:14.502902 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-eb82b87c-6706-4ec8-a257-b82f98c22cf9 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:14.503348 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-eb82b87c-6706-4ec8-a257-b82f98c22cf9 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:14.503983 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-eb82b87c-6706-4ec8-a257-b82f98c22cf9 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:14.600218 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.network.neutron [None req-90b723b7-3dcf-487d-83bf-a039851b9c86 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] validate_networks() for [('5e442a98-2910-4a15-af47-032a445d42de', None, None, None, None, None)] {{(pid=125485) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 11:43:14.634371 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-eb82b87c-6706-4ec8-a257-b82f98c22cf9 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:14.642633 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-eb82b87c-6706-4ec8-a257-b82f98c22cf9 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1548 microversion: 2.1 time: 0.151531 Oct 18 11:43:14.643203 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 182/387] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:14 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:43:14.665233 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-c384960b-bb30-4f96-8fe5-f748e83bc114 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:14.666280 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-c384960b-bb30-4f96-8fe5-f748e83bc114 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:14.671748 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c384960b-bb30-4f96-8fe5-f748e83bc114 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:14.672226 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c384960b-bb30-4f96-8fe5-f748e83bc114 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:14.672647 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c384960b-bb30-4f96-8fe5-f748e83bc114 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:14.673362 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c384960b-bb30-4f96-8fe5-f748e83bc114 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:14.673801 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c384960b-bb30-4f96-8fe5-f748e83bc114 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:14.674231 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c384960b-bb30-4f96-8fe5-f748e83bc114 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:14.813413 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-c384960b-bb30-4f96-8fe5-f748e83bc114 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:14.822150 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-c384960b-bb30-4f96-8fe5-f748e83bc114 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1548 microversion: 2.1 time: 0.161209 Oct 18 11:43:14.822721 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 183/388] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:14 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:43:14.844371 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-dff8918f-1e8e-40ab-9b1e-06b6ab7c2443 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:14.850047 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-dff8918f-1e8e-40ab-9b1e-06b6ab7c2443 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:14.850909 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-dff8918f-1e8e-40ab-9b1e-06b6ab7c2443 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Searching by: {'deleted': False, 'project_id': 'b63f8bd1dce742b09e413947db416e66'} {{(pid=125486) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 11:43:14.857675 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dff8918f-1e8e-40ab-9b1e-06b6ab7c2443 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:14.858233 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dff8918f-1e8e-40ab-9b1e-06b6ab7c2443 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:14.858670 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dff8918f-1e8e-40ab-9b1e-06b6ab7c2443 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:14.859400 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dff8918f-1e8e-40ab-9b1e-06b6ab7c2443 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:14.859851 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dff8918f-1e8e-40ab-9b1e-06b6ab7c2443 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:14.860269 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dff8918f-1e8e-40ab-9b1e-06b6ab7c2443 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:14.953466 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.multi_cell_list [None req-dff8918f-1e8e-40ab-9b1e-06b6ab7c2443 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125486) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 11:43:14.975793 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-90b723b7-3dcf-487d-83bf-a039851b9c86 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Flavor limits 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 11:43:14.976257 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-90b723b7-3dcf-487d-83bf-a039851b9c86 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Image limits 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 11:43:14.976669 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-90b723b7-3dcf-487d-83bf-a039851b9c86 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Flavor pref 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 11:43:14.977117 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-90b723b7-3dcf-487d-83bf-a039851b9c86 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Image pref 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 11:43:14.977524 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-90b723b7-3dcf-487d-83bf-a039851b9c86 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 11:43:14.986092 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-90b723b7-3dcf-487d-83bf-a039851b9c86 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:14.986569 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-90b723b7-3dcf-487d-83bf-a039851b9c86 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:14.986990 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-90b723b7-3dcf-487d-83bf-a039851b9c86 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:14.987698 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-90b723b7-3dcf-487d-83bf-a039851b9c86 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:14.988140 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-90b723b7-3dcf-487d-83bf-a039851b9c86 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:14.988549 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-90b723b7-3dcf-487d-83bf-a039851b9c86 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:15.004810 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.quota [None req-90b723b7-3dcf-487d-83bf-a039851b9c86 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Getting quotas for project 34d789b867f24711a6c1b5589a573560. Resources: {'cores', 'instances', 'ram'} {{(pid=125485) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:43:15.009035 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.quota [None req-90b723b7-3dcf-487d-83bf-a039851b9c86 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Getting quotas for user f76d70b021f44d1391653477c65f95af and project 34d789b867f24711a6c1b5589a573560. Resources: {'cores', 'instances', 'ram'} {{(pid=125485) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:43:15.047678 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-dff8918f-1e8e-40ab-9b1e-06b6ab7c2443 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.207030 Oct 18 11:43:15.048268 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 184/389] 10.222.0.17 () {58 vars in 1125 bytes} [Tue Oct 18 11:43:14 2022] GET /compute/v2.1/servers => generated 342 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:43:15.059924 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-4a7b0f00-46dd-4a7a-9337-18819ee2f4c5 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:15.060524 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-4a7b0f00-46dd-4a7a-9337-18819ee2f4c5 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:15.066164 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4a7b0f00-46dd-4a7a-9337-18819ee2f4c5 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:15.066648 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4a7b0f00-46dd-4a7a-9337-18819ee2f4c5 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:15.067076 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4a7b0f00-46dd-4a7a-9337-18819ee2f4c5 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:15.067758 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4a7b0f00-46dd-4a7a-9337-18819ee2f4c5 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:15.068414 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-90b723b7-3dcf-487d-83bf-a039851b9c86 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Going to run 1 instances... {{(pid=125485) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 11:43:15.068738 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4a7b0f00-46dd-4a7a-9337-18819ee2f4c5 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:15.069177 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4a7b0f00-46dd-4a7a-9337-18819ee2f4c5 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:15.070779 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-90b723b7-3dcf-487d-83bf-a039851b9c86 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='47567028-6de9-4f1a-ad20-4363b4d5fae1',volume_size=None,volume_type=None)] {{(pid=125485) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 11:43:15.211208 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-4a7b0f00-46dd-4a7a-9337-18819ee2f4c5 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:15.213020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-90b723b7-3dcf-487d-83bf-a039851b9c86 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.731959 Oct 18 11:43:15.213665 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 206/390] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Oct 18 11:43:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 11:43:15.219331 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-b93e0eb3-1dca-4607-a9c4-a9754c7f7025 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:15.220023 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-b93e0eb3-1dca-4607-a9c4-a9754c7f7025 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:15.220778 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-4a7b0f00-46dd-4a7a-9337-18819ee2f4c5 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1548 microversion: 2.1 time: 0.164448 Oct 18 11:43:15.221478 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 185/391] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:15 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1548 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:43:15.226278 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b93e0eb3-1dca-4607-a9c4-a9754c7f7025 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:15.226699 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b93e0eb3-1dca-4607-a9c4-a9754c7f7025 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:15.227129 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b93e0eb3-1dca-4607-a9c4-a9754c7f7025 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:15.227818 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b93e0eb3-1dca-4607-a9c4-a9754c7f7025 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:15.228417 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b93e0eb3-1dca-4607-a9c4-a9754c7f7025 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:15.229020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b93e0eb3-1dca-4607-a9c4-a9754c7f7025 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:15.231402 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-a3ef7b73-02a5-4481-9a30-9ac98d000395 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:15.232624 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-a3ef7b73-02a5-4481-9a30-9ac98d000395 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:15.295092 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-a3ef7b73-02a5-4481-9a30-9ac98d000395 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:15.303304 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-a3ef7b73-02a5-4481-9a30-9ac98d000395 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1088 microversion: 2.1 time: 0.076645 Oct 18 11:43:15.304066 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 186/392] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:15 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1088 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:15.310118 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-095c7aae-2836-409b-b895-ed94a5273227 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:15.310118 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-095c7aae-2836-409b-b895-ed94a5273227 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:15.316637 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-095c7aae-2836-409b-b895-ed94a5273227 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:15.317569 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-095c7aae-2836-409b-b895-ed94a5273227 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:15.318422 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-095c7aae-2836-409b-b895-ed94a5273227 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:15.319143 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-095c7aae-2836-409b-b895-ed94a5273227 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:15.319602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-095c7aae-2836-409b-b895-ed94a5273227 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:15.320023 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-095c7aae-2836-409b-b895-ed94a5273227 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:15.393388 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-b93e0eb3-1dca-4607-a9c4-a9754c7f7025 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:15.401781 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-b93e0eb3-1dca-4607-a9c4-a9754c7f7025 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1367 microversion: 2.1 time: 0.186519 Oct 18 11:43:15.402356 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 207/393] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:15 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:15.501124 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-095c7aae-2836-409b-b895-ed94a5273227 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:15.511034 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-095c7aae-2836-409b-b895-ed94a5273227 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:15.512785 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-095c7aae-2836-409b-b895-ed94a5273227 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:15.514060 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-095c7aae-2836-409b-b895-ed94a5273227 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1722 microversion: 2.20 time: 0.208968 Oct 18 11:43:15.529380 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 187/394] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:15 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:43:16.327400 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-aea1712b-3be5-418b-aa21-566511576704 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:16.328075 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-aea1712b-3be5-418b-aa21-566511576704 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:16.334976 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-aea1712b-3be5-418b-aa21-566511576704 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:16.335449 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-aea1712b-3be5-418b-aa21-566511576704 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:16.335873 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-aea1712b-3be5-418b-aa21-566511576704 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:16.336808 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-aea1712b-3be5-418b-aa21-566511576704 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:16.337289 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-aea1712b-3be5-418b-aa21-566511576704 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:16.337708 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-aea1712b-3be5-418b-aa21-566511576704 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:16.398799 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-aea1712b-3be5-418b-aa21-566511576704 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:16.406304 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-aea1712b-3be5-418b-aa21-566511576704 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1138 microversion: 2.1 time: 0.082765 Oct 18 11:43:16.406865 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 208/395] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:16 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1138 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:16.425022 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-57b39cf1-10cc-4820-930d-b724537a2621 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:16.425633 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-57b39cf1-10cc-4820-930d-b724537a2621 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:16.432020 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-57b39cf1-10cc-4820-930d-b724537a2621 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:16.432441 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-57b39cf1-10cc-4820-930d-b724537a2621 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:16.432896 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-57b39cf1-10cc-4820-930d-b724537a2621 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:16.433580 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-57b39cf1-10cc-4820-930d-b724537a2621 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:16.434029 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-57b39cf1-10cc-4820-930d-b724537a2621 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:16.434445 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-57b39cf1-10cc-4820-930d-b724537a2621 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:16.540314 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-38a77f88-8d50-4e6b-acd6-fd9664a38361 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:16.541144 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-38a77f88-8d50-4e6b-acd6-fd9664a38361 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:16.547110 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-38a77f88-8d50-4e6b-acd6-fd9664a38361 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:16.547595 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-38a77f88-8d50-4e6b-acd6-fd9664a38361 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:16.548023 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-38a77f88-8d50-4e6b-acd6-fd9664a38361 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:16.548715 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-38a77f88-8d50-4e6b-acd6-fd9664a38361 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:16.549186 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-38a77f88-8d50-4e6b-acd6-fd9664a38361 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:16.549613 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-38a77f88-8d50-4e6b-acd6-fd9664a38361 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:16.564110 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-57b39cf1-10cc-4820-930d-b724537a2621 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:16.572779 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-57b39cf1-10cc-4820-930d-b724537a2621 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1367 microversion: 2.1 time: 0.151545 Oct 18 11:43:16.573466 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 188/396] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:16 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:16.684102 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-38a77f88-8d50-4e6b-acd6-fd9664a38361 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:16.692118 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-38a77f88-8d50-4e6b-acd6-fd9664a38361 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:16.693605 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-38a77f88-8d50-4e6b-acd6-fd9664a38361 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:16.694764 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-38a77f88-8d50-4e6b-acd6-fd9664a38361 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1722 microversion: 2.20 time: 0.159143 Oct 18 11:43:16.695321 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 209/397] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:16 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:43:17.429718 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-cb5999de-2956-465c-93da-579c31ee9ec9 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:17.430318 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-cb5999de-2956-465c-93da-579c31ee9ec9 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:17.436527 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cb5999de-2956-465c-93da-579c31ee9ec9 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:17.436980 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cb5999de-2956-465c-93da-579c31ee9ec9 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:17.437404 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cb5999de-2956-465c-93da-579c31ee9ec9 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:17.438447 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cb5999de-2956-465c-93da-579c31ee9ec9 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:17.438897 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cb5999de-2956-465c-93da-579c31ee9ec9 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:17.439313 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cb5999de-2956-465c-93da-579c31ee9ec9 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:17.503807 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-cb5999de-2956-465c-93da-579c31ee9ec9 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:17.511993 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-cb5999de-2956-465c-93da-579c31ee9ec9 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1138 microversion: 2.1 time: 0.086164 Oct 18 11:43:17.512543 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 189/398] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:17 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1138 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:17.595478 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-6a4b10f7-4ad1-41f2-9033-9e48d8cbfa03 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:17.596124 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-6a4b10f7-4ad1-41f2-9033-9e48d8cbfa03 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:17.602091 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6a4b10f7-4ad1-41f2-9033-9e48d8cbfa03 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:17.602577 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6a4b10f7-4ad1-41f2-9033-9e48d8cbfa03 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:17.603009 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6a4b10f7-4ad1-41f2-9033-9e48d8cbfa03 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:17.603690 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6a4b10f7-4ad1-41f2-9033-9e48d8cbfa03 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:17.604140 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6a4b10f7-4ad1-41f2-9033-9e48d8cbfa03 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:17.604562 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6a4b10f7-4ad1-41f2-9033-9e48d8cbfa03 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:17.720417 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-04e42629-af14-4978-ab85-e46765c68163 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:17.721238 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-04e42629-af14-4978-ab85-e46765c68163 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:17.727587 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-04e42629-af14-4978-ab85-e46765c68163 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:17.728183 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-04e42629-af14-4978-ab85-e46765c68163 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:17.728808 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-04e42629-af14-4978-ab85-e46765c68163 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:17.729620 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-04e42629-af14-4978-ab85-e46765c68163 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:17.730184 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-04e42629-af14-4978-ab85-e46765c68163 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:17.730716 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-04e42629-af14-4978-ab85-e46765c68163 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:17.804943 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-6a4b10f7-4ad1-41f2-9033-9e48d8cbfa03 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:17.808613 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:43:17.814703 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-6a4b10f7-4ad1-41f2-9033-9e48d8cbfa03 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1367 microversion: 2.1 time: 0.222969 Oct 18 11:43:17.815290 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 210/399] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:17 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:17.879087 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-04e42629-af14-4978-ab85-e46765c68163 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:17.888033 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-04e42629-af14-4978-ab85-e46765c68163 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:17.889506 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-04e42629-af14-4978-ab85-e46765c68163 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:17.890745 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-04e42629-af14-4978-ab85-e46765c68163 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1722 microversion: 2.20 time: 0.174450 Oct 18 11:43:17.891451 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 190/400] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:17 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:43:18.535169 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-bae290a4-f1c4-46c2-b8fa-c75e924f3cfe tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:18.535768 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-bae290a4-f1c4-46c2-b8fa-c75e924f3cfe tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:18.543583 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bae290a4-f1c4-46c2-b8fa-c75e924f3cfe tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:18.544070 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bae290a4-f1c4-46c2-b8fa-c75e924f3cfe tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:18.544497 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bae290a4-f1c4-46c2-b8fa-c75e924f3cfe tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:18.545398 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bae290a4-f1c4-46c2-b8fa-c75e924f3cfe tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:18.545861 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bae290a4-f1c4-46c2-b8fa-c75e924f3cfe tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:18.546283 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bae290a4-f1c4-46c2-b8fa-c75e924f3cfe tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:18.608975 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-bae290a4-f1c4-46c2-b8fa-c75e924f3cfe tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:18.616807 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-bae290a4-f1c4-46c2-b8fa-c75e924f3cfe tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1186 microversion: 2.1 time: 0.085442 Oct 18 11:43:18.617409 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 211/401] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:18 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1186 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:18.838830 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-fb525431-322e-4866-9233-901921d27a2e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:18.840202 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-fb525431-322e-4866-9233-901921d27a2e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:18.847002 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fb525431-322e-4866-9233-901921d27a2e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:18.847539 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fb525431-322e-4866-9233-901921d27a2e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:18.847960 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fb525431-322e-4866-9233-901921d27a2e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:18.848662 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fb525431-322e-4866-9233-901921d27a2e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:18.849190 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fb525431-322e-4866-9233-901921d27a2e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:18.849743 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fb525431-322e-4866-9233-901921d27a2e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:18.918773 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-bd10146d-a242-4a13-b953-c268738d366b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:18.919389 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-bd10146d-a242-4a13-b953-c268738d366b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:18.927008 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bd10146d-a242-4a13-b953-c268738d366b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:18.927525 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bd10146d-a242-4a13-b953-c268738d366b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:18.928164 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bd10146d-a242-4a13-b953-c268738d366b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:18.929229 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bd10146d-a242-4a13-b953-c268738d366b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:18.930010 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bd10146d-a242-4a13-b953-c268738d366b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:18.930572 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bd10146d-a242-4a13-b953-c268738d366b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:18.994587 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-fb525431-322e-4866-9233-901921d27a2e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:19.003522 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-fb525431-322e-4866-9233-901921d27a2e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1367 microversion: 2.1 time: 0.168293 Oct 18 11:43:19.015390 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 191/402] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:18 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:19.026604 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-47a29c2e-859d-4905-adb4-bf871fdf510a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a3c86e6-31af-4e02-bd73-76aeb83e8df1"}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:43:19.029383 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-47a29c2e-859d-4905-adb4-bf871fdf510a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:19.035998 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-47a29c2e-859d-4905-adb4-bf871fdf510a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:19.036522 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-47a29c2e-859d-4905-adb4-bf871fdf510a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:19.036990 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-47a29c2e-859d-4905-adb4-bf871fdf510a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:19.037788 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-47a29c2e-859d-4905-adb4-bf871fdf510a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:19.038128 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-47a29c2e-859d-4905-adb4-bf871fdf510a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:19.038537 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-47a29c2e-859d-4905-adb4-bf871fdf510a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:19.097687 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-bd10146d-a242-4a13-b953-c268738d366b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:19.106059 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-bd10146d-a242-4a13-b953-c268738d366b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:19.107519 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-bd10146d-a242-4a13-b953-c268738d366b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:19.108769 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-bd10146d-a242-4a13-b953-c268738d366b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1722 microversion: 2.20 time: 0.196144 Oct 18 11:43:19.109347 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 212/403] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:18 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:43:19.383000 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-47a29c2e-859d-4905-adb4-bf871fdf510a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "POST /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.360657 Oct 18 11:43:19.383589 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 192/404] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Oct 18 11:43:19 2022] POST /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e/os-volume_attachments => generated 194 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:43:19.639364 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-254fed46-06a6-49a4-885c-34f8aeb9719a tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:19.640077 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-254fed46-06a6-49a4-885c-34f8aeb9719a tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:19.645965 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-254fed46-06a6-49a4-885c-34f8aeb9719a tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:19.646438 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-254fed46-06a6-49a4-885c-34f8aeb9719a tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:19.646863 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-254fed46-06a6-49a4-885c-34f8aeb9719a tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:19.647550 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-254fed46-06a6-49a4-885c-34f8aeb9719a tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:19.647995 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-254fed46-06a6-49a4-885c-34f8aeb9719a tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:19.648416 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-254fed46-06a6-49a4-885c-34f8aeb9719a tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:19.712172 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-254fed46-06a6-49a4-885c-34f8aeb9719a tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:19.719870 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-254fed46-06a6-49a4-885c-34f8aeb9719a tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1186 microversion: 2.1 time: 0.084296 Oct 18 11:43:19.720450 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 213/405] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:19 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1186 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:20.028082 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-bd19e6d4-c07d-4b47-b1d6-aec2bc14148a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:20.028767 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-bd19e6d4-c07d-4b47-b1d6-aec2bc14148a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:20.035273 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-bd19e6d4-c07d-4b47-b1d6-aec2bc14148a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:20.035744 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-bd19e6d4-c07d-4b47-b1d6-aec2bc14148a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:20.036169 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-bd19e6d4-c07d-4b47-b1d6-aec2bc14148a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:20.036863 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-bd19e6d4-c07d-4b47-b1d6-aec2bc14148a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:20.037348 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-bd19e6d4-c07d-4b47-b1d6-aec2bc14148a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:20.037759 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-bd19e6d4-c07d-4b47-b1d6-aec2bc14148a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:20.135059 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ca8e1ac9-609b-4ce3-9263-7ea4a0a80b90 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:20.135669 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-ca8e1ac9-609b-4ce3-9263-7ea4a0a80b90 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:20.141914 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ca8e1ac9-609b-4ce3-9263-7ea4a0a80b90 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:20.142398 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ca8e1ac9-609b-4ce3-9263-7ea4a0a80b90 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:20.143011 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ca8e1ac9-609b-4ce3-9263-7ea4a0a80b90 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:20.143911 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ca8e1ac9-609b-4ce3-9263-7ea4a0a80b90 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:20.144360 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ca8e1ac9-609b-4ce3-9263-7ea4a0a80b90 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:20.144976 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ca8e1ac9-609b-4ce3-9263-7ea4a0a80b90 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:20.186040 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-bd19e6d4-c07d-4b47-b1d6-aec2bc14148a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:20.194734 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-bd19e6d4-c07d-4b47-b1d6-aec2bc14148a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1555 microversion: 2.1 time: 0.170871 Oct 18 11:43:20.195639 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 193/406] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:20 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:20.217851 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-d7588c8e-3f60-45d8-be23-7276b0e86a3e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:20.218347 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-d7588c8e-3f60-45d8-be23-7276b0e86a3e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:20.224526 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d7588c8e-3f60-45d8-be23-7276b0e86a3e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:20.225048 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d7588c8e-3f60-45d8-be23-7276b0e86a3e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:20.225487 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d7588c8e-3f60-45d8-be23-7276b0e86a3e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:20.226175 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d7588c8e-3f60-45d8-be23-7276b0e86a3e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:20.226628 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d7588c8e-3f60-45d8-be23-7276b0e86a3e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:20.227054 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d7588c8e-3f60-45d8-be23-7276b0e86a3e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:20.289783 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-ca8e1ac9-609b-4ce3-9263-7ea4a0a80b90 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:20.299240 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-ca8e1ac9-609b-4ce3-9263-7ea4a0a80b90 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:20.300827 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-ca8e1ac9-609b-4ce3-9263-7ea4a0a80b90 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:20.302208 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-ca8e1ac9-609b-4ce3-9263-7ea4a0a80b90 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1722 microversion: 2.20 time: 0.171747 Oct 18 11:43:20.304180 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 214/407] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:20 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:43:20.305887 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-d7588c8e-3f60-45d8-be23-7276b0e86a3e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091824 Oct 18 11:43:20.306470 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 194/408] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Oct 18 11:43:20 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:43:20.743437 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-694ac99e-01b2-49f5-b855-74c9a46e282a tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:20.744203 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-694ac99e-01b2-49f5-b855-74c9a46e282a tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:20.751445 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-694ac99e-01b2-49f5-b855-74c9a46e282a tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:20.751929 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-694ac99e-01b2-49f5-b855-74c9a46e282a tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:20.752499 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-694ac99e-01b2-49f5-b855-74c9a46e282a tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:20.753095 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-694ac99e-01b2-49f5-b855-74c9a46e282a tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:20.753727 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-694ac99e-01b2-49f5-b855-74c9a46e282a tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:20.754310 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-694ac99e-01b2-49f5-b855-74c9a46e282a tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:20.840006 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-694ac99e-01b2-49f5-b855-74c9a46e282a tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:20.849117 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-694ac99e-01b2-49f5-b855-74c9a46e282a tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1204 microversion: 2.1 time: 0.109988 Oct 18 11:43:20.850466 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 215/409] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:20 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1204 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:21.316371 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-3c2f2296-1efd-452b-a4c5-109af6cafa8a req-cdb4a5d5-5026-4886-a2e2-b2b5722735c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ea63cc8-527d-46ea-b6ef-d778dadb8ec5", "tag": "c6da8082-87ec-4172-bf6f-d60ef1511c4e"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:43:21.332727 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-32a10ca2-3aa1-44d8-a03f-e194c2d09a2f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:21.333944 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-32a10ca2-3aa1-44d8-a03f-e194c2d09a2f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:21.347481 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-32a10ca2-3aa1-44d8-a03f-e194c2d09a2f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:21.347980 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-32a10ca2-3aa1-44d8-a03f-e194c2d09a2f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:21.348412 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-32a10ca2-3aa1-44d8-a03f-e194c2d09a2f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:21.349147 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-32a10ca2-3aa1-44d8-a03f-e194c2d09a2f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:21.349635 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-32a10ca2-3aa1-44d8-a03f-e194c2d09a2f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:21.354171 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-3c2f2296-1efd-452b-a4c5-109af6cafa8a req-cdb4a5d5-5026-4886-a2e2-b2b5722735c8 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:21.354929 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-3c2f2296-1efd-452b-a4c5-109af6cafa8a req-cdb4a5d5-5026-4886-a2e2-b2b5722735c8 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:21.355558 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-32a10ca2-3aa1-44d8-a03f-e194c2d09a2f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:21.358250 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-3c2f2296-1efd-452b-a4c5-109af6cafa8a req-cdb4a5d5-5026-4886-a2e2-b2b5722735c8 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:21.373279 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-3c2f2296-1efd-452b-a4c5-109af6cafa8a req-cdb4a5d5-5026-4886-a2e2-b2b5722735c8 service nova] Creating event network-changed:c6da8082-87ec-4172-bf6f-d60ef1511c4e for instance 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 on hv-cinder-81558 Oct 18 11:43:21.378617 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-3c2f2296-1efd-452b-a4c5-109af6cafa8a req-cdb4a5d5-5026-4886-a2e2-b2b5722735c8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066862 Oct 18 11:43:21.379771 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 195/410] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:43:21.876917 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-ad57748f-3908-4659-8605-12dc2541bb34 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:21.877190 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-ad57748f-3908-4659-8605-12dc2541bb34 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:21.885228 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ad57748f-3908-4659-8605-12dc2541bb34 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:21.885716 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ad57748f-3908-4659-8605-12dc2541bb34 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:21.896135 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ad57748f-3908-4659-8605-12dc2541bb34 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:21.897926 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ad57748f-3908-4659-8605-12dc2541bb34 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:21.898660 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ad57748f-3908-4659-8605-12dc2541bb34 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:21.899248 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ad57748f-3908-4659-8605-12dc2541bb34 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:21.907914 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:43:22.127474 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-32a10ca2-3aa1-44d8-a03f-e194c2d09a2f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:22.142084 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-32a10ca2-3aa1-44d8-a03f-e194c2d09a2f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:22.143874 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-32a10ca2-3aa1-44d8-a03f-e194c2d09a2f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:22.145317 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-32a10ca2-3aa1-44d8-a03f-e194c2d09a2f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1722 microversion: 2.20 time: 0.819304 Oct 18 11:43:22.147003 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 216/411] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:21 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1722 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:43:22.215521 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-ad57748f-3908-4659-8605-12dc2541bb34 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:22.225101 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-ad57748f-3908-4659-8605-12dc2541bb34 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1271 microversion: 2.1 time: 0.354925 Oct 18 11:43:22.225993 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 196/412] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:21 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1271 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:22.760312 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-5ae60bf1-502a-4310-a5af-115e5b7b4aba req-daab7418-9829-4444-89bc-0df56454943a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29b0847b-6a68-4b35-91d4-1ce725985f01", "tag": "ffd48d58-8fbc-42a2-a002-1687b4c71e8e"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:43:22.774752 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-5ae60bf1-502a-4310-a5af-115e5b7b4aba req-daab7418-9829-4444-89bc-0df56454943a service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:22.775222 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-5ae60bf1-502a-4310-a5af-115e5b7b4aba req-daab7418-9829-4444-89bc-0df56454943a service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:22.775645 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-5ae60bf1-502a-4310-a5af-115e5b7b4aba req-daab7418-9829-4444-89bc-0df56454943a service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:22.789349 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-5ae60bf1-502a-4310-a5af-115e5b7b4aba req-daab7418-9829-4444-89bc-0df56454943a service nova] Creating event network-changed:ffd48d58-8fbc-42a2-a002-1687b4c71e8e for instance 29b0847b-6a68-4b35-91d4-1ce725985f01 on hv-cinder-81558 Oct 18 11:43:22.794985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-5ae60bf1-502a-4310-a5af-115e5b7b4aba req-daab7418-9829-4444-89bc-0df56454943a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038233 Oct 18 11:43:22.796186 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 217/413] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:43:23.171718 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-4f1a2cb3-36ef-42cf-aa3c-54b1f3bb802d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:23.172330 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-4f1a2cb3-36ef-42cf-aa3c-54b1f3bb802d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:23.178978 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4f1a2cb3-36ef-42cf-aa3c-54b1f3bb802d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:23.179615 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4f1a2cb3-36ef-42cf-aa3c-54b1f3bb802d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:23.180062 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4f1a2cb3-36ef-42cf-aa3c-54b1f3bb802d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:23.184834 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4f1a2cb3-36ef-42cf-aa3c-54b1f3bb802d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:23.185431 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4f1a2cb3-36ef-42cf-aa3c-54b1f3bb802d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:23.185929 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4f1a2cb3-36ef-42cf-aa3c-54b1f3bb802d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:23.250868 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ae859d0b-cd64-4195-b284-320e23a1de75 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:23.251604 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-ae859d0b-cd64-4195-b284-320e23a1de75 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:23.258375 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ae859d0b-cd64-4195-b284-320e23a1de75 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:23.259164 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ae859d0b-cd64-4195-b284-320e23a1de75 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:23.259764 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ae859d0b-cd64-4195-b284-320e23a1de75 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:23.260645 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ae859d0b-cd64-4195-b284-320e23a1de75 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:23.261126 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ae859d0b-cd64-4195-b284-320e23a1de75 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:23.261547 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ae859d0b-cd64-4195-b284-320e23a1de75 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:23.323614 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-4f1a2cb3-36ef-42cf-aa3c-54b1f3bb802d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:23.332070 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-4f1a2cb3-36ef-42cf-aa3c-54b1f3bb802d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:23.333480 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-4f1a2cb3-36ef-42cf-aa3c-54b1f3bb802d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:23.335246 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-4f1a2cb3-36ef-42cf-aa3c-54b1f3bb802d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1722 microversion: 2.20 time: 0.167591 Oct 18 11:43:23.335803 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 197/414] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:23 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:43:23.493030 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-ae859d0b-cd64-4195-b284-320e23a1de75 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:23.500903 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-ae859d0b-cd64-4195-b284-320e23a1de75 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1271 microversion: 2.1 time: 0.255381 Oct 18 11:43:23.501477 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 218/415] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:23 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1271 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:43:24.360001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-3cfe0d05-8ebb-416e-8be2-b49b41ceb0ea tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:24.360598 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-3cfe0d05-8ebb-416e-8be2-b49b41ceb0ea tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:24.367565 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3cfe0d05-8ebb-416e-8be2-b49b41ceb0ea tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:24.368044 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3cfe0d05-8ebb-416e-8be2-b49b41ceb0ea tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:24.368469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3cfe0d05-8ebb-416e-8be2-b49b41ceb0ea tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:24.369198 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3cfe0d05-8ebb-416e-8be2-b49b41ceb0ea tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:24.369652 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3cfe0d05-8ebb-416e-8be2-b49b41ceb0ea tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:24.370194 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3cfe0d05-8ebb-416e-8be2-b49b41ceb0ea tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:24.507855 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-3cfe0d05-8ebb-416e-8be2-b49b41ceb0ea tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:24.515831 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-3cfe0d05-8ebb-416e-8be2-b49b41ceb0ea tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:24.517302 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-3cfe0d05-8ebb-416e-8be2-b49b41ceb0ea tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:24.518530 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-3cfe0d05-8ebb-416e-8be2-b49b41ceb0ea tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1722 microversion: 2.20 time: 0.162696 Oct 18 11:43:24.519088 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 198/416] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:24 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:43:24.523444 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-2495ceee-35b6-4dad-8279-f535b2f7a9a8 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:24.524053 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-2495ceee-35b6-4dad-8279-f535b2f7a9a8 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:24.530627 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2495ceee-35b6-4dad-8279-f535b2f7a9a8 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:24.531108 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2495ceee-35b6-4dad-8279-f535b2f7a9a8 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:24.531539 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2495ceee-35b6-4dad-8279-f535b2f7a9a8 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:24.532236 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2495ceee-35b6-4dad-8279-f535b2f7a9a8 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:24.532683 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2495ceee-35b6-4dad-8279-f535b2f7a9a8 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:24.533159 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2495ceee-35b6-4dad-8279-f535b2f7a9a8 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:24.665280 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-2495ceee-35b6-4dad-8279-f535b2f7a9a8 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:24.672937 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-2495ceee-35b6-4dad-8279-f535b2f7a9a8 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1271 microversion: 2.1 time: 0.153361 Oct 18 11:43:24.673498 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 219/417] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:24 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1271 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:43:25.543662 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-fdb64b40-6ded-406a-875f-0502ab33d009 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:25.544198 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-fdb64b40-6ded-406a-875f-0502ab33d009 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:25.546079 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell0:SELECT=2 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:43:25.546759 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell0:SELECT=2 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:43:25.553284 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fdb64b40-6ded-406a-875f-0502ab33d009 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:25.553764 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fdb64b40-6ded-406a-875f-0502ab33d009 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:25.554196 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fdb64b40-6ded-406a-875f-0502ab33d009 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:25.554880 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fdb64b40-6ded-406a-875f-0502ab33d009 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:25.555336 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fdb64b40-6ded-406a-875f-0502ab33d009 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:25.555756 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fdb64b40-6ded-406a-875f-0502ab33d009 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:25.688444 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-fdb64b40-6ded-406a-875f-0502ab33d009 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:25.695787 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ef60a7a2-6e98-4e01-90b7-11f8da2eafca tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:25.696402 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-ef60a7a2-6e98-4e01-90b7-11f8da2eafca tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:25.699348 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell0:SELECT=2 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:43:25.699992 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell0:SELECT=6 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:43:25.703958 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-fdb64b40-6ded-406a-875f-0502ab33d009 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:25.704430 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ef60a7a2-6e98-4e01-90b7-11f8da2eafca tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:25.704937 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ef60a7a2-6e98-4e01-90b7-11f8da2eafca tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:25.705374 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ef60a7a2-6e98-4e01-90b7-11f8da2eafca tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:25.705507 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-fdb64b40-6ded-406a-875f-0502ab33d009 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:25.706079 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ef60a7a2-6e98-4e01-90b7-11f8da2eafca tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:25.706529 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ef60a7a2-6e98-4e01-90b7-11f8da2eafca tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:25.706872 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-fdb64b40-6ded-406a-875f-0502ab33d009 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1722 microversion: 2.20 time: 0.167279 Oct 18 11:43:25.706974 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ef60a7a2-6e98-4e01-90b7-11f8da2eafca tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:25.707427 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 199/418] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:25 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:43:25.839468 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-ef60a7a2-6e98-4e01-90b7-11f8da2eafca tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:25.847398 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-ef60a7a2-6e98-4e01-90b7-11f8da2eafca tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1271 microversion: 2.1 time: 0.155379 Oct 18 11:43:25.847959 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 220/419] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:25 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:26.733263 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-c704bc3f-7841-4feb-acb7-48be62d3dfb3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:26.733867 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-c704bc3f-7841-4feb-acb7-48be62d3dfb3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:26.740657 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c704bc3f-7841-4feb-acb7-48be62d3dfb3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:26.741173 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c704bc3f-7841-4feb-acb7-48be62d3dfb3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:26.741600 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c704bc3f-7841-4feb-acb7-48be62d3dfb3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:26.742277 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c704bc3f-7841-4feb-acb7-48be62d3dfb3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:26.742713 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c704bc3f-7841-4feb-acb7-48be62d3dfb3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:26.743127 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c704bc3f-7841-4feb-acb7-48be62d3dfb3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:26.871146 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-9377764b-e5ad-4f0e-a891-bbf03c92937c tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:26.871840 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-9377764b-e5ad-4f0e-a891-bbf03c92937c tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:26.880061 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-c704bc3f-7841-4feb-acb7-48be62d3dfb3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:26.880575 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9377764b-e5ad-4f0e-a891-bbf03c92937c tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:26.881829 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9377764b-e5ad-4f0e-a891-bbf03c92937c tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:26.882456 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9377764b-e5ad-4f0e-a891-bbf03c92937c tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:26.883347 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9377764b-e5ad-4f0e-a891-bbf03c92937c tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:26.883978 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9377764b-e5ad-4f0e-a891-bbf03c92937c tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:26.884591 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9377764b-e5ad-4f0e-a891-bbf03c92937c tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:26.890397 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-c704bc3f-7841-4feb-acb7-48be62d3dfb3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:26.892370 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-c704bc3f-7841-4feb-acb7-48be62d3dfb3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:26.893623 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-c704bc3f-7841-4feb-acb7-48be62d3dfb3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1722 microversion: 2.20 time: 0.164295 Oct 18 11:43:26.906171 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 200/420] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:26 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:43:27.028218 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-9377764b-e5ad-4f0e-a891-bbf03c92937c tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:27.035838 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-9377764b-e5ad-4f0e-a891-bbf03c92937c tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1271 microversion: 2.1 time: 0.168697 Oct 18 11:43:27.036399 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 221/421] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:26 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:27.923468 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-b43807f2-92e5-483a-8673-e0e6dde6cbbb tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:27.924360 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-b43807f2-92e5-483a-8673-e0e6dde6cbbb tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:27.932502 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b43807f2-92e5-483a-8673-e0e6dde6cbbb tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:27.933303 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b43807f2-92e5-483a-8673-e0e6dde6cbbb tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:27.933720 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b43807f2-92e5-483a-8673-e0e6dde6cbbb tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:27.934838 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b43807f2-92e5-483a-8673-e0e6dde6cbbb tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:27.935289 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b43807f2-92e5-483a-8673-e0e6dde6cbbb tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:27.935739 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b43807f2-92e5-483a-8673-e0e6dde6cbbb tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:28.065854 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-5da8d787-b191-452a-85ef-2d5bbe61b221 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:28.067449 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-5da8d787-b191-452a-85ef-2d5bbe61b221 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:28.093388 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5da8d787-b191-452a-85ef-2d5bbe61b221 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:28.094109 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5da8d787-b191-452a-85ef-2d5bbe61b221 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:28.094560 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5da8d787-b191-452a-85ef-2d5bbe61b221 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:28.095425 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5da8d787-b191-452a-85ef-2d5bbe61b221 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:28.095930 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5da8d787-b191-452a-85ef-2d5bbe61b221 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:28.096352 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5da8d787-b191-452a-85ef-2d5bbe61b221 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:28.099543 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-b43807f2-92e5-483a-8673-e0e6dde6cbbb tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:28.109663 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-b43807f2-92e5-483a-8673-e0e6dde6cbbb tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:28.111378 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-b43807f2-92e5-483a-8673-e0e6dde6cbbb tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:28.112681 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-b43807f2-92e5-483a-8673-e0e6dde6cbbb tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1722 microversion: 2.20 time: 0.193315 Oct 18 11:43:28.113680 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 201/422] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:27 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:43:28.207875 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-61e62506-d3d7-4867-9019-c16ba2c3a57a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:28.208926 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-61e62506-d3d7-4867-9019-c16ba2c3a57a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:28.215768 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-61e62506-d3d7-4867-9019-c16ba2c3a57a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:28.216493 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-61e62506-d3d7-4867-9019-c16ba2c3a57a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:28.217370 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-61e62506-d3d7-4867-9019-c16ba2c3a57a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:28.217675 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-61e62506-d3d7-4867-9019-c16ba2c3a57a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:28.218424 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-61e62506-d3d7-4867-9019-c16ba2c3a57a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:28.218898 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-61e62506-d3d7-4867-9019-c16ba2c3a57a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:28.276401 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-5da8d787-b191-452a-85ef-2d5bbe61b221 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:28.285196 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-5da8d787-b191-452a-85ef-2d5bbe61b221 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1271 microversion: 2.1 time: 0.229988 Oct 18 11:43:28.285768 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 222/423] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:28 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1271 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:28.366353 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-61e62506-d3d7-4867-9019-c16ba2c3a57a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:28.374468 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-61e62506-d3d7-4867-9019-c16ba2c3a57a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1594 microversion: 2.1 time: 0.170596 Oct 18 11:43:28.375024 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 202/424] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:28 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1594 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:43:29.138939 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-d4027470-d9cf-423d-9248-89893851e154 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:29.139542 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-d4027470-d9cf-423d-9248-89893851e154 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:29.146442 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d4027470-d9cf-423d-9248-89893851e154 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:29.146914 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d4027470-d9cf-423d-9248-89893851e154 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:29.147344 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d4027470-d9cf-423d-9248-89893851e154 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:29.148034 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d4027470-d9cf-423d-9248-89893851e154 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:29.148479 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d4027470-d9cf-423d-9248-89893851e154 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:29.148913 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d4027470-d9cf-423d-9248-89893851e154 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:29.307958 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-25deb1a1-1eba-4938-b32d-0565f263a530 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:29.308572 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-25deb1a1-1eba-4938-b32d-0565f263a530 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:29.315174 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-25deb1a1-1eba-4938-b32d-0565f263a530 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:29.315654 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-25deb1a1-1eba-4938-b32d-0565f263a530 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:29.316083 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-25deb1a1-1eba-4938-b32d-0565f263a530 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:29.316773 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-25deb1a1-1eba-4938-b32d-0565f263a530 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:29.317251 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-25deb1a1-1eba-4938-b32d-0565f263a530 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:29.317665 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-25deb1a1-1eba-4938-b32d-0565f263a530 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:29.377379 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-d4027470-d9cf-423d-9248-89893851e154 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:29.387528 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-d4027470-d9cf-423d-9248-89893851e154 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:29.389357 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-d4027470-d9cf-423d-9248-89893851e154 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:29.390665 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-d4027470-d9cf-423d-9248-89893851e154 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1722 microversion: 2.20 time: 0.255677 Oct 18 11:43:29.391218 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 223/425] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:29 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:43:29.460344 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-25deb1a1-1eba-4938-b32d-0565f263a530 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:29.468340 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-25deb1a1-1eba-4938-b32d-0565f263a530 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1259 microversion: 2.1 time: 0.164339 Oct 18 11:43:29.468935 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 203/426] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:29 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:30.223086 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-78dec80d-ad90-4bf5-8fd6-16fe835e7e27 req-54f0a6bf-6257-474f-823e-dfcb703e413e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fc6ee0a-b135-42dc-9099-30672626af2e", "tag": "dad12b9b-8fc3-457f-a59d-d7e7760984cc"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:43:30.234123 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-78dec80d-ad90-4bf5-8fd6-16fe835e7e27 req-54f0a6bf-6257-474f-823e-dfcb703e413e service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:30.234599 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-78dec80d-ad90-4bf5-8fd6-16fe835e7e27 req-54f0a6bf-6257-474f-823e-dfcb703e413e service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:30.235020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-78dec80d-ad90-4bf5-8fd6-16fe835e7e27 req-54f0a6bf-6257-474f-823e-dfcb703e413e service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:30.248658 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-78dec80d-ad90-4bf5-8fd6-16fe835e7e27 req-54f0a6bf-6257-474f-823e-dfcb703e413e service nova] Creating event network-changed:dad12b9b-8fc3-457f-a59d-d7e7760984cc for instance 0fc6ee0a-b135-42dc-9099-30672626af2e on hv-cinder-81558 Oct 18 11:43:30.256159 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-78dec80d-ad90-4bf5-8fd6-16fe835e7e27 req-54f0a6bf-6257-474f-823e-dfcb703e413e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036032 Oct 18 11:43:30.257807 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 224/427] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:43:30.417182 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-2a5db490-d4c1-4504-947f-67aa4e945696 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:30.417894 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-2a5db490-d4c1-4504-947f-67aa4e945696 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:30.425624 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2a5db490-d4c1-4504-947f-67aa4e945696 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:30.426452 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2a5db490-d4c1-4504-947f-67aa4e945696 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:30.427107 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2a5db490-d4c1-4504-947f-67aa4e945696 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:30.429143 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2a5db490-d4c1-4504-947f-67aa4e945696 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:30.430159 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2a5db490-d4c1-4504-947f-67aa4e945696 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:30.430794 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2a5db490-d4c1-4504-947f-67aa4e945696 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:30.493043 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-e9aebfea-72cb-4d60-b8f0-7dcba3a19ba6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:30.493842 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-e9aebfea-72cb-4d60-b8f0-7dcba3a19ba6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:30.505985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e9aebfea-72cb-4d60-b8f0-7dcba3a19ba6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:30.507521 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e9aebfea-72cb-4d60-b8f0-7dcba3a19ba6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:30.509084 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e9aebfea-72cb-4d60-b8f0-7dcba3a19ba6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:30.510299 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e9aebfea-72cb-4d60-b8f0-7dcba3a19ba6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:30.511749 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e9aebfea-72cb-4d60-b8f0-7dcba3a19ba6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:30.512249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e9aebfea-72cb-4d60-b8f0-7dcba3a19ba6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:30.678250 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-2a5db490-d4c1-4504-947f-67aa4e945696 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:30.687168 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-2a5db490-d4c1-4504-947f-67aa4e945696 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:30.688611 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-2a5db490-d4c1-4504-947f-67aa4e945696 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:30.690279 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-2a5db490-d4c1-4504-947f-67aa4e945696 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1743 microversion: 2.20 time: 0.278571 Oct 18 11:43:30.691017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 204/428] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:30 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1743 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:43:30.708265 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-e9aebfea-72cb-4d60-b8f0-7dcba3a19ba6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:30.717022 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-e9aebfea-72cb-4d60-b8f0-7dcba3a19ba6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1259 microversion: 2.1 time: 0.229526 Oct 18 11:43:30.717598 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 225/429] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:30 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1259 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:43:31.378802 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-1d9e4e0e-cca8-4f65-980e-3f0f9dd5c69b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-681467887"}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:43:31.379432 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-1d9e4e0e-cca8-4f65-980e-3f0f9dd5c69b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:31.386387 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1d9e4e0e-cca8-4f65-980e-3f0f9dd5c69b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:31.386834 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1d9e4e0e-cca8-4f65-980e-3f0f9dd5c69b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:31.387531 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1d9e4e0e-cca8-4f65-980e-3f0f9dd5c69b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:31.388219 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1d9e4e0e-cca8-4f65-980e-3f0f9dd5c69b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:31.388672 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1d9e4e0e-cca8-4f65-980e-3f0f9dd5c69b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:31.389121 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1d9e4e0e-cca8-4f65-980e-3f0f9dd5c69b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:31.520349 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.network.security_group_api [None req-1d9e4e0e-cca8-4f65-980e-3f0f9dd5c69b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Adding security group d68e1368-1fe2-42c7-a727-14ec310f05e4 to port dad12b9b-8fc3-457f-a59d-d7e7760984cc Oct 18 11:43:31.718839 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-967efb36-d214-44ec-b534-a5595a11f77e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:31.720047 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-967efb36-d214-44ec-b534-a5595a11f77e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:31.727931 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-967efb36-d214-44ec-b534-a5595a11f77e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:31.727931 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-967efb36-d214-44ec-b534-a5595a11f77e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:31.727931 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-967efb36-d214-44ec-b534-a5595a11f77e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:31.728419 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-967efb36-d214-44ec-b534-a5595a11f77e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:31.728988 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-967efb36-d214-44ec-b534-a5595a11f77e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:31.729504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-967efb36-d214-44ec-b534-a5595a11f77e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:31.883660 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-967efb36-d214-44ec-b534-a5595a11f77e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:31.897015 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-967efb36-d214-44ec-b534-a5595a11f77e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:31.900791 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-967efb36-d214-44ec-b534-a5595a11f77e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:31.902106 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-967efb36-d214-44ec-b534-a5595a11f77e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1743 microversion: 2.20 time: 0.187183 Oct 18 11:43:31.913546 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 226/430] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:31 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1743 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:43:31.913546 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-d06942a1-2010-4f29-9b04-3d4e885518d9 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:31.913546 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-d06942a1-2010-4f29-9b04-3d4e885518d9 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:31.918354 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d06942a1-2010-4f29-9b04-3d4e885518d9 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:31.918904 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d06942a1-2010-4f29-9b04-3d4e885518d9 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:31.919367 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d06942a1-2010-4f29-9b04-3d4e885518d9 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:31.920089 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d06942a1-2010-4f29-9b04-3d4e885518d9 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:31.920545 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d06942a1-2010-4f29-9b04-3d4e885518d9 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:31.921382 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d06942a1-2010-4f29-9b04-3d4e885518d9 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:32.119119 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-1d9e4e0e-cca8-4f65-980e-3f0f9dd5c69b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "POST /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e/action" status: 202 len: 0 microversion: 2.1 time: 0.744134 Oct 18 11:43:32.120376 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 205/431] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Oct 18 11:43:31 2022] POST /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e/action => generated 0 bytes in 746 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 11:43:32.126263 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-717e3f0c-259c-49e1-9aaf-68435e9c2fc1 req-e27ecaf2-1fde-41bb-bc1c-c47e233bf635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2b9dfa2-7553-47cd-8274-6a0004bac79d", "name": "network-vif-plugged", "status": "completed", "tag": "03f3558a-e868-4501-8139-30b9edad14e0"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:43:32.138639 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-717e3f0c-259c-49e1-9aaf-68435e9c2fc1 req-e27ecaf2-1fde-41bb-bc1c-c47e233bf635 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:32.139520 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-717e3f0c-259c-49e1-9aaf-68435e9c2fc1 req-e27ecaf2-1fde-41bb-bc1c-c47e233bf635 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:32.141378 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-717e3f0c-259c-49e1-9aaf-68435e9c2fc1 req-e27ecaf2-1fde-41bb-bc1c-c47e233bf635 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:32.160357 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-717e3f0c-259c-49e1-9aaf-68435e9c2fc1 req-e27ecaf2-1fde-41bb-bc1c-c47e233bf635 service nova] Creating event network-vif-plugged:03f3558a-e868-4501-8139-30b9edad14e0 for instance a2b9dfa2-7553-47cd-8274-6a0004bac79d on hv-cinder-81558 Oct 18 11:43:32.167846 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-717e3f0c-259c-49e1-9aaf-68435e9c2fc1 req-e27ecaf2-1fde-41bb-bc1c-c47e233bf635 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045788 Oct 18 11:43:32.171334 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 206/432] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:43:32.180628 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-93a508ea-d14c-46af-ae13-a89eafea4ca9 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:32.185664 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-93a508ea-d14c-46af-ae13-a89eafea4ca9 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:32.198820 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-93a508ea-d14c-46af-ae13-a89eafea4ca9 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:32.199734 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-93a508ea-d14c-46af-ae13-a89eafea4ca9 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:32.201155 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-93a508ea-d14c-46af-ae13-a89eafea4ca9 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:32.202360 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-93a508ea-d14c-46af-ae13-a89eafea4ca9 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:32.203043 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-93a508ea-d14c-46af-ae13-a89eafea4ca9 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:32.203659 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-93a508ea-d14c-46af-ae13-a89eafea4ca9 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:32.371442 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-93a508ea-d14c-46af-ae13-a89eafea4ca9 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:32.383167 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-93a508ea-d14c-46af-ae13-a89eafea4ca9 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1759 microversion: 2.1 time: 0.210237 Oct 18 11:43:32.383748 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 207/433] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:32 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1759 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:32.391436 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-a9ad6311-e076-47ad-8183-d503997ece91 req-11f5cdbb-fef3-4b48-9e88-daab06e9e352 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fc6ee0a-b135-42dc-9099-30672626af2e", "tag": "dad12b9b-8fc3-457f-a59d-d7e7760984cc"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:43:32.402035 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-a9ad6311-e076-47ad-8183-d503997ece91 req-11f5cdbb-fef3-4b48-9e88-daab06e9e352 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:32.402698 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-a9ad6311-e076-47ad-8183-d503997ece91 req-11f5cdbb-fef3-4b48-9e88-daab06e9e352 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:32.403284 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-a9ad6311-e076-47ad-8183-d503997ece91 req-11f5cdbb-fef3-4b48-9e88-daab06e9e352 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:32.409728 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-d06942a1-2010-4f29-9b04-3d4e885518d9 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:32.417936 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-a9ad6311-e076-47ad-8183-d503997ece91 req-11f5cdbb-fef3-4b48-9e88-daab06e9e352 service nova] Creating event network-changed:dad12b9b-8fc3-457f-a59d-d7e7760984cc for instance 0fc6ee0a-b135-42dc-9099-30672626af2e on hv-cinder-81558 Oct 18 11:43:32.423113 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-a9ad6311-e076-47ad-8183-d503997ece91 req-11f5cdbb-fef3-4b48-9e88-daab06e9e352 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037847 Oct 18 11:43:32.423807 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 208/434] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:43:32.425207 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-d06942a1-2010-4f29-9b04-3d4e885518d9 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1259 microversion: 2.1 time: 0.520816 Oct 18 11:43:32.430319 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 227/435] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:31 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1259 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:32.932808 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-423b5a00-34e8-472a-a9d7-06345b3ced34 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:32.934367 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-423b5a00-34e8-472a-a9d7-06345b3ced34 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:32.940957 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-423b5a00-34e8-472a-a9d7-06345b3ced34 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:32.942005 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-423b5a00-34e8-472a-a9d7-06345b3ced34 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:32.942511 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-423b5a00-34e8-472a-a9d7-06345b3ced34 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:32.943861 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-423b5a00-34e8-472a-a9d7-06345b3ced34 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:32.944375 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-423b5a00-34e8-472a-a9d7-06345b3ced34 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:32.945079 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-423b5a00-34e8-472a-a9d7-06345b3ced34 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:33.127128 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-423b5a00-34e8-472a-a9d7-06345b3ced34 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:33.141565 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-423b5a00-34e8-472a-a9d7-06345b3ced34 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:33.143151 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-423b5a00-34e8-472a-a9d7-06345b3ced34 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:33.148152 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-423b5a00-34e8-472a-a9d7-06345b3ced34 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1743 microversion: 2.20 time: 0.220805 Oct 18 11:43:33.148890 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 209/436] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:32 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1743 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:43:33.452884 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-e56ba3ed-15a6-452d-a6ed-4faccfd13e32 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:33.453708 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-e56ba3ed-15a6-452d-a6ed-4faccfd13e32 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:33.456176 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:43:33.462153 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e56ba3ed-15a6-452d-a6ed-4faccfd13e32 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:33.462633 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e56ba3ed-15a6-452d-a6ed-4faccfd13e32 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:33.463279 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e56ba3ed-15a6-452d-a6ed-4faccfd13e32 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:33.464190 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e56ba3ed-15a6-452d-a6ed-4faccfd13e32 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:33.464641 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e56ba3ed-15a6-452d-a6ed-4faccfd13e32 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:33.465088 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e56ba3ed-15a6-452d-a6ed-4faccfd13e32 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:33.604821 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-e56ba3ed-15a6-452d-a6ed-4faccfd13e32 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:33.608366 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=100 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:43:33.613932 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-e56ba3ed-15a6-452d-a6ed-4faccfd13e32 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1259 microversion: 2.1 time: 0.164741 Oct 18 11:43:33.614262 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 228/437] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:33 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:34.174860 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-da2499d2-42d3-467e-8f58-000f1965b41c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:34.176260 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-da2499d2-42d3-467e-8f58-000f1965b41c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:34.187532 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-da2499d2-42d3-467e-8f58-000f1965b41c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:34.188635 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-da2499d2-42d3-467e-8f58-000f1965b41c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:34.189280 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-da2499d2-42d3-467e-8f58-000f1965b41c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:34.189984 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-da2499d2-42d3-467e-8f58-000f1965b41c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:34.190439 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-da2499d2-42d3-467e-8f58-000f1965b41c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:34.190852 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-da2499d2-42d3-467e-8f58-000f1965b41c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:34.357116 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-da2499d2-42d3-467e-8f58-000f1965b41c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:34.367963 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-da2499d2-42d3-467e-8f58-000f1965b41c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:34.370338 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-da2499d2-42d3-467e-8f58-000f1965b41c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:34.371859 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-da2499d2-42d3-467e-8f58-000f1965b41c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1738 microversion: 2.20 time: 0.200594 Oct 18 11:43:34.380880 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 210/438] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:34 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:43:34.589710 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-19dde76e-b4da-4566-af1b-9c3d53b25684 req-8477b4e2-37d1-4f61-8059-6487b41a6827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29b0847b-6a68-4b35-91d4-1ce725985f01", "name": "network-vif-plugged", "status": "completed", "tag": "ffd48d58-8fbc-42a2-a002-1687b4c71e8e"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:43:34.601302 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-19dde76e-b4da-4566-af1b-9c3d53b25684 req-8477b4e2-37d1-4f61-8059-6487b41a6827 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:34.602047 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-19dde76e-b4da-4566-af1b-9c3d53b25684 req-8477b4e2-37d1-4f61-8059-6487b41a6827 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:34.602622 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-19dde76e-b4da-4566-af1b-9c3d53b25684 req-8477b4e2-37d1-4f61-8059-6487b41a6827 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:34.621452 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-19dde76e-b4da-4566-af1b-9c3d53b25684 req-8477b4e2-37d1-4f61-8059-6487b41a6827 service nova] Creating event network-vif-plugged:ffd48d58-8fbc-42a2-a002-1687b4c71e8e for instance 29b0847b-6a68-4b35-91d4-1ce725985f01 on hv-cinder-81558 Oct 18 11:43:34.627082 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-19dde76e-b4da-4566-af1b-9c3d53b25684 req-8477b4e2-37d1-4f61-8059-6487b41a6827 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041177 Oct 18 11:43:34.628118 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 229/439] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:43:34.635924 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-da4e6ae8-3e65-40b0-92fe-391ab0377003 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:34.636562 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-da4e6ae8-3e65-40b0-92fe-391ab0377003 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:34.643232 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-da4e6ae8-3e65-40b0-92fe-391ab0377003 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:34.643910 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-da4e6ae8-3e65-40b0-92fe-391ab0377003 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:34.644494 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-da4e6ae8-3e65-40b0-92fe-391ab0377003 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:34.645746 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-da4e6ae8-3e65-40b0-92fe-391ab0377003 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:34.646401 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-da4e6ae8-3e65-40b0-92fe-391ab0377003 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:34.647120 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-da4e6ae8-3e65-40b0-92fe-391ab0377003 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:34.813224 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-da4e6ae8-3e65-40b0-92fe-391ab0377003 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:34.844212 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-da4e6ae8-3e65-40b0-92fe-391ab0377003 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1259 microversion: 2.1 time: 0.212397 Oct 18 11:43:34.844796 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 211/440] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:34 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1259 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:35.400905 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-b632d175-7bfc-4a39-b023-8a2aad918947 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:35.401597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-b632d175-7bfc-4a39-b023-8a2aad918947 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:35.408369 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b632d175-7bfc-4a39-b023-8a2aad918947 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:35.409134 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b632d175-7bfc-4a39-b023-8a2aad918947 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:35.409758 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b632d175-7bfc-4a39-b023-8a2aad918947 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:35.410665 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b632d175-7bfc-4a39-b023-8a2aad918947 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:35.411370 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b632d175-7bfc-4a39-b023-8a2aad918947 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:35.411765 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b632d175-7bfc-4a39-b023-8a2aad918947 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:35.559355 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-b632d175-7bfc-4a39-b023-8a2aad918947 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:35.570441 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-b632d175-7bfc-4a39-b023-8a2aad918947 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:35.572013 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-b632d175-7bfc-4a39-b023-8a2aad918947 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:35.573296 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-b632d175-7bfc-4a39-b023-8a2aad918947 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1738 microversion: 2.20 time: 0.177422 Oct 18 11:43:35.574250 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 230/441] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:35 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:43:35.868071 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-dd7b3c09-4460-425e-a9a8-a96cfcd499c5 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:35.870383 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-dd7b3c09-4460-425e-a9a8-a96cfcd499c5 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:35.873347 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_api:SELECT=87 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:43:35.879077 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dd7b3c09-4460-425e-a9a8-a96cfcd499c5 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:35.879564 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dd7b3c09-4460-425e-a9a8-a96cfcd499c5 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:35.879997 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dd7b3c09-4460-425e-a9a8-a96cfcd499c5 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:35.880697 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dd7b3c09-4460-425e-a9a8-a96cfcd499c5 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:35.881187 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dd7b3c09-4460-425e-a9a8-a96cfcd499c5 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:35.882311 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dd7b3c09-4460-425e-a9a8-a96cfcd499c5 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:36.045506 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-dd7b3c09-4460-425e-a9a8-a96cfcd499c5 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:36.053980 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-dd7b3c09-4460-425e-a9a8-a96cfcd499c5 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1259 microversion: 2.1 time: 0.190123 Oct 18 11:43:36.054570 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 212/442] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:35 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1259 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:36.602568 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-e774cf3c-e45d-47d1-82ec-d3e82216ecb5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:36.603850 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-e774cf3c-e45d-47d1-82ec-d3e82216ecb5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:36.611544 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e774cf3c-e45d-47d1-82ec-d3e82216ecb5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:36.612312 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e774cf3c-e45d-47d1-82ec-d3e82216ecb5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:36.612998 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e774cf3c-e45d-47d1-82ec-d3e82216ecb5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:36.613934 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e774cf3c-e45d-47d1-82ec-d3e82216ecb5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:36.614393 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e774cf3c-e45d-47d1-82ec-d3e82216ecb5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:36.617667 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e774cf3c-e45d-47d1-82ec-d3e82216ecb5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:36.767829 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-e774cf3c-e45d-47d1-82ec-d3e82216ecb5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:36.782075 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-e774cf3c-e45d-47d1-82ec-d3e82216ecb5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:36.783640 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-e774cf3c-e45d-47d1-82ec-d3e82216ecb5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:36.784817 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-e774cf3c-e45d-47d1-82ec-d3e82216ecb5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1738 microversion: 2.20 time: 0.189218 Oct 18 11:43:36.788930 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 231/443] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:36 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:43:37.078779 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-177b5f7b-c3af-41aa-be1d-6b1a845463e0 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:37.080199 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-177b5f7b-c3af-41aa-be1d-6b1a845463e0 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:37.090018 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-177b5f7b-c3af-41aa-be1d-6b1a845463e0 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:37.090608 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-177b5f7b-c3af-41aa-be1d-6b1a845463e0 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:37.091143 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-177b5f7b-c3af-41aa-be1d-6b1a845463e0 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:37.091913 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-177b5f7b-c3af-41aa-be1d-6b1a845463e0 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:37.092462 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-177b5f7b-c3af-41aa-be1d-6b1a845463e0 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:37.092983 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-177b5f7b-c3af-41aa-be1d-6b1a845463e0 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:37.260035 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-177b5f7b-c3af-41aa-be1d-6b1a845463e0 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:37.270139 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-177b5f7b-c3af-41aa-be1d-6b1a845463e0 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1444 microversion: 2.1 time: 0.195275 Oct 18 11:43:37.281233 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 213/444] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:37 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1444 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:37.297885 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-6bb12429-b076-4161-8432-6da27931fbb6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:37.299711 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-6bb12429-b076-4161-8432-6da27931fbb6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:37.307761 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6bb12429-b076-4161-8432-6da27931fbb6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:37.308477 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6bb12429-b076-4161-8432-6da27931fbb6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:37.309200 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6bb12429-b076-4161-8432-6da27931fbb6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:37.310067 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6bb12429-b076-4161-8432-6da27931fbb6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:37.310666 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6bb12429-b076-4161-8432-6da27931fbb6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:37.311243 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6bb12429-b076-4161-8432-6da27931fbb6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:37.465278 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-6bb12429-b076-4161-8432-6da27931fbb6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:37.473770 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-6bb12429-b076-4161-8432-6da27931fbb6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1444 microversion: 2.1 time: 0.181033 Oct 18 11:43:37.474554 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 232/445] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:37 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1444 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:37.812101 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-3a2bb4fd-d449-4f8b-b7df-bc3b4972998d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:37.812710 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-3a2bb4fd-d449-4f8b-b7df-bc3b4972998d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:37.822971 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3a2bb4fd-d449-4f8b-b7df-bc3b4972998d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:37.823803 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3a2bb4fd-d449-4f8b-b7df-bc3b4972998d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:37.824545 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3a2bb4fd-d449-4f8b-b7df-bc3b4972998d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:37.829051 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3a2bb4fd-d449-4f8b-b7df-bc3b4972998d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:37.833343 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3a2bb4fd-d449-4f8b-b7df-bc3b4972998d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:37.834201 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3a2bb4fd-d449-4f8b-b7df-bc3b4972998d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:37.858572 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell1:SELECT=100 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:43:38.063247 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-3a2bb4fd-d449-4f8b-b7df-bc3b4972998d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:38.076408 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-3a2bb4fd-d449-4f8b-b7df-bc3b4972998d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:38.079787 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-3a2bb4fd-d449-4f8b-b7df-bc3b4972998d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:38.082486 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-3a2bb4fd-d449-4f8b-b7df-bc3b4972998d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1738 microversion: 2.20 time: 0.274888 Oct 18 11:43:38.083621 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 214/446] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:37 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1738 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:43:39.120169 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-215ea697-e4e4-44cf-8565-e98aae4fc9ee tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:39.120951 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-215ea697-e4e4-44cf-8565-e98aae4fc9ee tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:39.135265 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-215ea697-e4e4-44cf-8565-e98aae4fc9ee tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:39.135772 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-215ea697-e4e4-44cf-8565-e98aae4fc9ee tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:39.136216 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-215ea697-e4e4-44cf-8565-e98aae4fc9ee tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:39.136970 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-215ea697-e4e4-44cf-8565-e98aae4fc9ee tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:39.137426 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-215ea697-e4e4-44cf-8565-e98aae4fc9ee tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:39.154760 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-215ea697-e4e4-44cf-8565-e98aae4fc9ee tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:39.325789 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-215ea697-e4e4-44cf-8565-e98aae4fc9ee tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:39.341398 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-215ea697-e4e4-44cf-8565-e98aae4fc9ee tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:39.343302 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-215ea697-e4e4-44cf-8565-e98aae4fc9ee tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:39.344812 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-215ea697-e4e4-44cf-8565-e98aae4fc9ee tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1738 microversion: 2.20 time: 0.231992 Oct 18 11:43:39.345700 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 233/447] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:39 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1738 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:43:39.682598 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-3090e241-3a6b-41c5-9ec2-d0010b02052f req-a68b6dce-6571-4d86-81c9-aba96fde42f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29b0847b-6a68-4b35-91d4-1ce725985f01", "tag": "ffd48d58-8fbc-42a2-a002-1687b4c71e8e"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:43:39.699025 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-3090e241-3a6b-41c5-9ec2-d0010b02052f req-a68b6dce-6571-4d86-81c9-aba96fde42f2 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:39.699816 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-3090e241-3a6b-41c5-9ec2-d0010b02052f req-a68b6dce-6571-4d86-81c9-aba96fde42f2 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:39.700241 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-3090e241-3a6b-41c5-9ec2-d0010b02052f req-a68b6dce-6571-4d86-81c9-aba96fde42f2 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:39.714569 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-3090e241-3a6b-41c5-9ec2-d0010b02052f req-a68b6dce-6571-4d86-81c9-aba96fde42f2 service nova] Creating event network-changed:ffd48d58-8fbc-42a2-a002-1687b4c71e8e for instance 29b0847b-6a68-4b35-91d4-1ce725985f01 on hv-cinder-81558 Oct 18 11:43:39.720212 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-3090e241-3a6b-41c5-9ec2-d0010b02052f req-a68b6dce-6571-4d86-81c9-aba96fde42f2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041692 Oct 18 11:43:39.721580 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 215/448] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:43:40.376187 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ba2ac614-dd23-4564-9d55-5a4d36f9e60e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:40.377518 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-ba2ac614-dd23-4564-9d55-5a4d36f9e60e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:40.385561 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ba2ac614-dd23-4564-9d55-5a4d36f9e60e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:40.386315 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ba2ac614-dd23-4564-9d55-5a4d36f9e60e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:40.387068 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ba2ac614-dd23-4564-9d55-5a4d36f9e60e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:40.388911 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ba2ac614-dd23-4564-9d55-5a4d36f9e60e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:40.389550 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ba2ac614-dd23-4564-9d55-5a4d36f9e60e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:40.390131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ba2ac614-dd23-4564-9d55-5a4d36f9e60e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:40.584603 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-ba2ac614-dd23-4564-9d55-5a4d36f9e60e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:40.604229 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-ba2ac614-dd23-4564-9d55-5a4d36f9e60e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:40.607362 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-ba2ac614-dd23-4564-9d55-5a4d36f9e60e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:40.609129 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-ba2ac614-dd23-4564-9d55-5a4d36f9e60e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1738 microversion: 2.20 time: 0.236741 Oct 18 11:43:40.609864 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 234/449] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:40 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:43:41.643315 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-d3c204e3-f516-4912-b8b4-57305bf9e00d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:41.644826 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-d3c204e3-f516-4912-b8b4-57305bf9e00d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:41.652580 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d3c204e3-f516-4912-b8b4-57305bf9e00d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:41.653315 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d3c204e3-f516-4912-b8b4-57305bf9e00d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:41.653741 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d3c204e3-f516-4912-b8b4-57305bf9e00d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:41.654753 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d3c204e3-f516-4912-b8b4-57305bf9e00d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:41.655383 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d3c204e3-f516-4912-b8b4-57305bf9e00d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:41.655803 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d3c204e3-f516-4912-b8b4-57305bf9e00d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:41.806795 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-d3c204e3-f516-4912-b8b4-57305bf9e00d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:41.817971 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-d3c204e3-f516-4912-b8b4-57305bf9e00d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:41.819993 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-d3c204e3-f516-4912-b8b4-57305bf9e00d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:41.821257 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-d3c204e3-f516-4912-b8b4-57305bf9e00d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1738 microversion: 2.20 time: 0.182507 Oct 18 11:43:41.822011 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 216/450] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:41 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:43:42.847058 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-7fba503a-2304-4e78-92df-2bef75a3b4d5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:42.848003 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-7fba503a-2304-4e78-92df-2bef75a3b4d5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:42.855444 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7fba503a-2304-4e78-92df-2bef75a3b4d5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:42.855932 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7fba503a-2304-4e78-92df-2bef75a3b4d5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:42.856366 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7fba503a-2304-4e78-92df-2bef75a3b4d5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:42.857091 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7fba503a-2304-4e78-92df-2bef75a3b4d5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:42.857552 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7fba503a-2304-4e78-92df-2bef75a3b4d5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:42.858006 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7fba503a-2304-4e78-92df-2bef75a3b4d5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:43.003526 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-7fba503a-2304-4e78-92df-2bef75a3b4d5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:43.012183 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-7fba503a-2304-4e78-92df-2bef75a3b4d5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:43.013652 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-7fba503a-2304-4e78-92df-2bef75a3b4d5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:43.014818 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-7fba503a-2304-4e78-92df-2bef75a3b4d5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1738 microversion: 2.20 time: 0.172007 Oct 18 11:43:43.015366 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 235/451] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:42 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:43:44.041839 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-21e2fc42-d4b5-4fb8-853c-1224bdf7ef60 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:44.042455 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-21e2fc42-d4b5-4fb8-853c-1224bdf7ef60 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:44.049443 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-21e2fc42-d4b5-4fb8-853c-1224bdf7ef60 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:44.049937 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-21e2fc42-d4b5-4fb8-853c-1224bdf7ef60 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:44.050376 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-21e2fc42-d4b5-4fb8-853c-1224bdf7ef60 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:44.051082 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-21e2fc42-d4b5-4fb8-853c-1224bdf7ef60 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:44.051536 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-21e2fc42-d4b5-4fb8-853c-1224bdf7ef60 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:44.051959 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-21e2fc42-d4b5-4fb8-853c-1224bdf7ef60 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:44.380600 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-21e2fc42-d4b5-4fb8-853c-1224bdf7ef60 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:44.389486 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-21e2fc42-d4b5-4fb8-853c-1224bdf7ef60 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:44.390935 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-21e2fc42-d4b5-4fb8-853c-1224bdf7ef60 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:44.392187 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-21e2fc42-d4b5-4fb8-853c-1224bdf7ef60 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1720 microversion: 2.20 time: 0.354984 Oct 18 11:43:44.392751 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 217/452] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:44 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1720 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:43:45.418072 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-f30eeb55-549e-4746-a9d1-b757b8c9789b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:45.418667 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-f30eeb55-549e-4746-a9d1-b757b8c9789b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:45.425050 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f30eeb55-549e-4746-a9d1-b757b8c9789b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:45.425527 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f30eeb55-549e-4746-a9d1-b757b8c9789b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:45.425956 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f30eeb55-549e-4746-a9d1-b757b8c9789b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:45.426662 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f30eeb55-549e-4746-a9d1-b757b8c9789b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:45.427107 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f30eeb55-549e-4746-a9d1-b757b8c9789b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:45.427518 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f30eeb55-549e-4746-a9d1-b757b8c9789b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:45.554826 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-f30eeb55-549e-4746-a9d1-b757b8c9789b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:45.562888 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-f30eeb55-549e-4746-a9d1-b757b8c9789b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:45.564310 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-f30eeb55-549e-4746-a9d1-b757b8c9789b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:45.565493 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-f30eeb55-549e-4746-a9d1-b757b8c9789b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1720 microversion: 2.20 time: 0.151328 Oct 18 11:43:45.566045 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 236/453] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:45 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:43:46.569242 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-831b1d23-f393-44a0-86e2-b993a1e74f64 req-8102e0e3-da0b-4b74-9c7f-4349be35ebe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2b9dfa2-7553-47cd-8274-6a0004bac79d", "name": "network-vif-unplugged", "status": "completed", "tag": "03f3558a-e868-4501-8139-30b9edad14e0"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:43:46.580262 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-831b1d23-f393-44a0-86e2-b993a1e74f64 req-8102e0e3-da0b-4b74-9c7f-4349be35ebe5 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:46.580736 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-831b1d23-f393-44a0-86e2-b993a1e74f64 req-8102e0e3-da0b-4b74-9c7f-4349be35ebe5 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:46.581188 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-831b1d23-f393-44a0-86e2-b993a1e74f64 req-8102e0e3-da0b-4b74-9c7f-4349be35ebe5 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:46.592646 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-03abf687-d603-4d59-b66b-81785254e7c4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:46.594160 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-03abf687-d603-4d59-b66b-81785254e7c4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:46.601263 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-831b1d23-f393-44a0-86e2-b993a1e74f64 req-8102e0e3-da0b-4b74-9c7f-4349be35ebe5 service nova] Creating event network-vif-unplugged:03f3558a-e868-4501-8139-30b9edad14e0 for instance a2b9dfa2-7553-47cd-8274-6a0004bac79d on hv-cinder-81558 Oct 18 11:43:46.606955 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-831b1d23-f393-44a0-86e2-b993a1e74f64 req-8102e0e3-da0b-4b74-9c7f-4349be35ebe5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042434 Oct 18 11:43:46.608138 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 218/454] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:43:46.611214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-03abf687-d603-4d59-b66b-81785254e7c4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:46.611848 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-03abf687-d603-4d59-b66b-81785254e7c4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:46.612369 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-03abf687-d603-4d59-b66b-81785254e7c4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:46.613200 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-03abf687-d603-4d59-b66b-81785254e7c4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:46.614008 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-03abf687-d603-4d59-b66b-81785254e7c4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:46.614720 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-03abf687-d603-4d59-b66b-81785254e7c4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:46.761353 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-03abf687-d603-4d59-b66b-81785254e7c4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:46.769720 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-03abf687-d603-4d59-b66b-81785254e7c4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:46.771171 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-03abf687-d603-4d59-b66b-81785254e7c4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:46.772367 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-03abf687-d603-4d59-b66b-81785254e7c4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1723 microversion: 2.20 time: 0.185133 Oct 18 11:43:46.772930 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 237/455] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:46 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:43:46.797650 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-c2c80e9f-cb29-4075-9a19-0381f9b362b4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53d2f173-e724-4c32-9a52-c211d400717d"}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:43:46.800014 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-c2c80e9f-cb29-4075-9a19-0381f9b362b4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:46.806655 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c2c80e9f-cb29-4075-9a19-0381f9b362b4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:46.807133 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c2c80e9f-cb29-4075-9a19-0381f9b362b4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:46.807559 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c2c80e9f-cb29-4075-9a19-0381f9b362b4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:46.808234 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c2c80e9f-cb29-4075-9a19-0381f9b362b4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:46.808680 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c2c80e9f-cb29-4075-9a19-0381f9b362b4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:46.809133 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c2c80e9f-cb29-4075-9a19-0381f9b362b4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:47.085956 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-c2c80e9f-cb29-4075-9a19-0381f9b362b4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "POST /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.292322 Oct 18 11:43:47.086590 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 219/456] 10.222.0.17 () {62 vars in 1364 bytes} [Tue Oct 18 11:43:46 2022] POST /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d/os-volume_attachments => generated 188 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 11:43:47.212286 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-6d158fa8-242d-415e-ac68-6bf7a7afcca9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:43:47.212886 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-6d158fa8-242d-415e-ac68-6bf7a7afcca9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:47.218798 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6d158fa8-242d-415e-ac68-6bf7a7afcca9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:47.219266 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6d158fa8-242d-415e-ac68-6bf7a7afcca9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:47.219698 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6d158fa8-242d-415e-ac68-6bf7a7afcca9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:47.220369 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6d158fa8-242d-415e-ac68-6bf7a7afcca9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:47.220811 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6d158fa8-242d-415e-ac68-6bf7a7afcca9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:47.221250 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6d158fa8-242d-415e-ac68-6bf7a7afcca9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:47.262663 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-6d158fa8-242d-415e-ac68-6bf7a7afcca9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125485) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 18 11:43:47.329886 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-6d158fa8-242d-415e-ac68-6bf7a7afcca9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "POST /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d/action" status: 202 len: 0 microversion: 2.20 time: 0.122196 Oct 18 11:43:47.330505 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 238/457] 10.222.0.17 () {62 vars in 1319 bytes} [Tue Oct 18 11:43:47 2022] POST /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 11:43:47.339364 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-a1aabb98-c93e-40d0-ba47-2dc07696984c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:47.340117 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-a1aabb98-c93e-40d0-ba47-2dc07696984c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:47.347174 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a1aabb98-c93e-40d0-ba47-2dc07696984c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:47.347790 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a1aabb98-c93e-40d0-ba47-2dc07696984c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:47.348220 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a1aabb98-c93e-40d0-ba47-2dc07696984c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:47.348933 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a1aabb98-c93e-40d0-ba47-2dc07696984c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:47.349383 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a1aabb98-c93e-40d0-ba47-2dc07696984c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:47.349828 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a1aabb98-c93e-40d0-ba47-2dc07696984c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:47.500481 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-a1aabb98-c93e-40d0-ba47-2dc07696984c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:47.510399 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-a1aabb98-c93e-40d0-ba47-2dc07696984c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:47.511841 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-a1aabb98-c93e-40d0-ba47-2dc07696984c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:47.513041 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-a1aabb98-c93e-40d0-ba47-2dc07696984c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1809 microversion: 2.20 time: 0.177792 Oct 18 11:43:47.513597 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 220/458] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:47 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:43:48.187531 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-cdf8e440-d6bb-4af2-9688-5c1a26b0df99 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:48.188008 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-cdf8e440-d6bb-4af2-9688-5c1a26b0df99 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:48.195171 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cdf8e440-d6bb-4af2-9688-5c1a26b0df99 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:48.195655 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cdf8e440-d6bb-4af2-9688-5c1a26b0df99 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:48.196083 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cdf8e440-d6bb-4af2-9688-5c1a26b0df99 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:48.196770 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cdf8e440-d6bb-4af2-9688-5c1a26b0df99 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:48.197244 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cdf8e440-d6bb-4af2-9688-5c1a26b0df99 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:48.197660 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cdf8e440-d6bb-4af2-9688-5c1a26b0df99 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:48.332538 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.objects.instance [None req-cdf8e440-d6bb-4af2-9688-5c1a26b0df99 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lazy-loading 'services' on Instance uuid 96c06c00-7190-4ae9-a194-2d8f6123a781 {{(pid=125485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:43:48.453487 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-cdf8e440-d6bb-4af2-9688-5c1a26b0df99 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "DELETE /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781/os-volume_attachments/cdb9065f-6ee5-463c-a205-20afa94a7220" status: 202 len: 0 microversion: 2.1 time: 0.270197 Oct 18 11:43:48.454341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 239/459] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Oct 18 11:43:48 2022] DELETE /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781/os-volume_attachments/cdb9065f-6ee5-463c-a205-20afa94a7220 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 11:43:48.539881 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-d173b1ee-a28d-4e30-aecf-d65345bdd85c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:48.540489 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-d173b1ee-a28d-4e30-aecf-d65345bdd85c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:48.547248 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d173b1ee-a28d-4e30-aecf-d65345bdd85c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:48.547733 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d173b1ee-a28d-4e30-aecf-d65345bdd85c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:48.548162 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d173b1ee-a28d-4e30-aecf-d65345bdd85c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:48.549272 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d173b1ee-a28d-4e30-aecf-d65345bdd85c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:48.549726 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d173b1ee-a28d-4e30-aecf-d65345bdd85c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:48.550147 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d173b1ee-a28d-4e30-aecf-d65345bdd85c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:48.688046 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-d173b1ee-a28d-4e30-aecf-d65345bdd85c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:48.697122 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-d173b1ee-a28d-4e30-aecf-d65345bdd85c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:48.698586 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-d173b1ee-a28d-4e30-aecf-d65345bdd85c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:48.699725 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-d173b1ee-a28d-4e30-aecf-d65345bdd85c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1751 microversion: 2.20 time: 0.164838 Oct 18 11:43:48.700272 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 221/460] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:48 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:43:49.729046 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-38184100-ae6b-4c64-b2e9-1e283ef12d05 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:49.729952 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-38184100-ae6b-4c64-b2e9-1e283ef12d05 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:49.736194 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-38184100-ae6b-4c64-b2e9-1e283ef12d05 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:49.736676 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-38184100-ae6b-4c64-b2e9-1e283ef12d05 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:49.737138 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-38184100-ae6b-4c64-b2e9-1e283ef12d05 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:49.737830 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-38184100-ae6b-4c64-b2e9-1e283ef12d05 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:49.738278 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-38184100-ae6b-4c64-b2e9-1e283ef12d05 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:49.738697 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-38184100-ae6b-4c64-b2e9-1e283ef12d05 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:49.875986 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-38184100-ae6b-4c64-b2e9-1e283ef12d05 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:49.885029 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-38184100-ae6b-4c64-b2e9-1e283ef12d05 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:49.887137 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-38184100-ae6b-4c64-b2e9-1e283ef12d05 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:49.888510 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-38184100-ae6b-4c64-b2e9-1e283ef12d05 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1807 microversion: 2.20 time: 0.165745 Oct 18 11:43:49.889152 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 240/461] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:49 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:43:50.639489 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-3bc3a2b5-520b-4af9-b088-b4e9dfee8f07 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:43:50.646061 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3bc3a2b5-520b-4af9-b088-b4e9dfee8f07 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:50.647152 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3bc3a2b5-520b-4af9-b088-b4e9dfee8f07 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:50.648037 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3bc3a2b5-520b-4af9-b088-b4e9dfee8f07 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:50.711026 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-3bc3a2b5-520b-4af9-b088-b4e9dfee8f07 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Going to try to stop instance {{(pid=125486) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 11:43:50.755007 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-3bc3a2b5-520b-4af9-b088-b4e9dfee8f07 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "POST /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781/action" status: 202 len: 0 microversion: 2.1 time: 0.119287 Oct 18 11:43:50.759493 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 222/462] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Oct 18 11:43:50 2022] POST /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 11:43:50.764650 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-d6b1ee14-1c89-4310-92ca-055e3789017e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:50.765313 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-d6b1ee14-1c89-4310-92ca-055e3789017e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:50.772407 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d6b1ee14-1c89-4310-92ca-055e3789017e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:50.773298 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d6b1ee14-1c89-4310-92ca-055e3789017e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:50.773937 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d6b1ee14-1c89-4310-92ca-055e3789017e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:50.774580 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d6b1ee14-1c89-4310-92ca-055e3789017e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:50.775074 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d6b1ee14-1c89-4310-92ca-055e3789017e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:50.775526 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d6b1ee14-1c89-4310-92ca-055e3789017e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:50.910929 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-d6b1ee14-1c89-4310-92ca-055e3789017e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:50.915336 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-84932d22-3f2e-4270-a79d-c77856ea59ca tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:50.916360 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-84932d22-3f2e-4270-a79d-c77856ea59ca tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:50.921299 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-d6b1ee14-1c89-4310-92ca-055e3789017e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1676 microversion: 2.1 time: 0.160582 Oct 18 11:43:50.922285 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 241/463] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:50 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:50.923380 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-84932d22-3f2e-4270-a79d-c77856ea59ca tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:50.923866 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-84932d22-3f2e-4270-a79d-c77856ea59ca tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:50.924293 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-84932d22-3f2e-4270-a79d-c77856ea59ca tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:50.925011 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-84932d22-3f2e-4270-a79d-c77856ea59ca tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:50.925455 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-84932d22-3f2e-4270-a79d-c77856ea59ca tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:50.926090 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-84932d22-3f2e-4270-a79d-c77856ea59ca tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:51.062544 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-84932d22-3f2e-4270-a79d-c77856ea59ca tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:51.072722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-84932d22-3f2e-4270-a79d-c77856ea59ca tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:51.074223 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-84932d22-3f2e-4270-a79d-c77856ea59ca tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:51.075382 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-84932d22-3f2e-4270-a79d-c77856ea59ca tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1807 microversion: 2.20 time: 0.164468 Oct 18 11:43:51.075929 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 223/464] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:50 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:43:51.945643 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-e1461a94-3d6e-413c-8676-c554d797e3e4 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:51.946188 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-e1461a94-3d6e-413c-8676-c554d797e3e4 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:51.952680 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e1461a94-3d6e-413c-8676-c554d797e3e4 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:51.953239 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e1461a94-3d6e-413c-8676-c554d797e3e4 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:51.953670 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e1461a94-3d6e-413c-8676-c554d797e3e4 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:51.954367 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e1461a94-3d6e-413c-8676-c554d797e3e4 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:51.954981 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e1461a94-3d6e-413c-8676-c554d797e3e4 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:51.955406 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e1461a94-3d6e-413c-8676-c554d797e3e4 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:52.101900 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-2e55ecf1-d2de-4153-b771-39f4e63a2351 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:52.102460 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-2e55ecf1-d2de-4153-b771-39f4e63a2351 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:52.106351 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-e1461a94-3d6e-413c-8676-c554d797e3e4 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:52.109445 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2e55ecf1-d2de-4153-b771-39f4e63a2351 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:52.109935 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2e55ecf1-d2de-4153-b771-39f4e63a2351 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:52.110978 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2e55ecf1-d2de-4153-b771-39f4e63a2351 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:52.112493 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2e55ecf1-d2de-4153-b771-39f4e63a2351 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:52.113302 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2e55ecf1-d2de-4153-b771-39f4e63a2351 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:52.114034 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2e55ecf1-d2de-4153-b771-39f4e63a2351 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:52.115108 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-e1461a94-3d6e-413c-8676-c554d797e3e4 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1676 microversion: 2.1 time: 0.173650 Oct 18 11:43:52.117322 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 242/465] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:51 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:52.262115 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-2e55ecf1-d2de-4153-b771-39f4e63a2351 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:52.278702 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-2e55ecf1-d2de-4153-b771-39f4e63a2351 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:52.280148 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-2e55ecf1-d2de-4153-b771-39f4e63a2351 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:52.281588 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-2e55ecf1-d2de-4153-b771-39f4e63a2351 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1807 microversion: 2.20 time: 0.184204 Oct 18 11:43:52.282326 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 224/466] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:52 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:43:53.139629 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-a097e8ed-b5b4-4e19-98fc-96e1ead0a5d3 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:53.140247 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-a097e8ed-b5b4-4e19-98fc-96e1ead0a5d3 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:53.146804 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a097e8ed-b5b4-4e19-98fc-96e1ead0a5d3 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:53.147306 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a097e8ed-b5b4-4e19-98fc-96e1ead0a5d3 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:53.147723 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a097e8ed-b5b4-4e19-98fc-96e1ead0a5d3 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:53.148451 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a097e8ed-b5b4-4e19-98fc-96e1ead0a5d3 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:53.148921 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a097e8ed-b5b4-4e19-98fc-96e1ead0a5d3 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:53.149347 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a097e8ed-b5b4-4e19-98fc-96e1ead0a5d3 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:53.294868 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-a097e8ed-b5b4-4e19-98fc-96e1ead0a5d3 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:53.302991 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-a097e8ed-b5b4-4e19-98fc-96e1ead0a5d3 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1676 microversion: 2.1 time: 0.167374 Oct 18 11:43:53.304527 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 243/467] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:53 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:53.314818 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-b450e18f-2388-41ed-8308-54c358b6fe33 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:53.316036 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-b450e18f-2388-41ed-8308-54c358b6fe33 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:53.323174 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b450e18f-2388-41ed-8308-54c358b6fe33 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:53.323685 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b450e18f-2388-41ed-8308-54c358b6fe33 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:53.324118 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b450e18f-2388-41ed-8308-54c358b6fe33 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:53.324815 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b450e18f-2388-41ed-8308-54c358b6fe33 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:53.325290 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b450e18f-2388-41ed-8308-54c358b6fe33 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:53.325707 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b450e18f-2388-41ed-8308-54c358b6fe33 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:53.471742 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-b450e18f-2388-41ed-8308-54c358b6fe33 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:53.481309 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-b450e18f-2388-41ed-8308-54c358b6fe33 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:53.482852 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-b450e18f-2388-41ed-8308-54c358b6fe33 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:53.484117 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-b450e18f-2388-41ed-8308-54c358b6fe33 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1807 microversion: 2.20 time: 0.180457 Oct 18 11:43:53.484755 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 225/468] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:53 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:43:54.328288 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ed6663aa-7d47-4c61-8890-55de41037468 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:54.328924 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-ed6663aa-7d47-4c61-8890-55de41037468 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:54.335943 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ed6663aa-7d47-4c61-8890-55de41037468 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:54.336424 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ed6663aa-7d47-4c61-8890-55de41037468 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:54.336866 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ed6663aa-7d47-4c61-8890-55de41037468 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:54.337553 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ed6663aa-7d47-4c61-8890-55de41037468 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:54.338000 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ed6663aa-7d47-4c61-8890-55de41037468 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:54.338472 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ed6663aa-7d47-4c61-8890-55de41037468 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:54.358477 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:43:54.482791 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-ed6663aa-7d47-4c61-8890-55de41037468 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:54.490683 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-ed6663aa-7d47-4c61-8890-55de41037468 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1676 microversion: 2.1 time: 0.166203 Oct 18 11:43:54.491797 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 244/469] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:54 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:54.510647 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-6725e659-9d50-4ae4-91cd-d38c813d241d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:54.511250 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-6725e659-9d50-4ae4-91cd-d38c813d241d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:54.518049 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6725e659-9d50-4ae4-91cd-d38c813d241d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:54.518529 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6725e659-9d50-4ae4-91cd-d38c813d241d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:54.519141 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6725e659-9d50-4ae4-91cd-d38c813d241d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:54.519977 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6725e659-9d50-4ae4-91cd-d38c813d241d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:54.520425 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6725e659-9d50-4ae4-91cd-d38c813d241d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:54.520981 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6725e659-9d50-4ae4-91cd-d38c813d241d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:54.708476 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-6725e659-9d50-4ae4-91cd-d38c813d241d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:54.718240 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-6725e659-9d50-4ae4-91cd-d38c813d241d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:54.719782 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-6725e659-9d50-4ae4-91cd-d38c813d241d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:54.721072 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-6725e659-9d50-4ae4-91cd-d38c813d241d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1807 microversion: 2.20 time: 0.214927 Oct 18 11:43:54.722004 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 226/470] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:54 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1807 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:43:55.514396 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-81f68373-c5e1-4033-badb-8fa338f4e1b9 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:55.514971 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-81f68373-c5e1-4033-badb-8fa338f4e1b9 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:55.521312 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-81f68373-c5e1-4033-badb-8fa338f4e1b9 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:55.521792 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-81f68373-c5e1-4033-badb-8fa338f4e1b9 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:55.522225 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-81f68373-c5e1-4033-badb-8fa338f4e1b9 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:55.523510 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-81f68373-c5e1-4033-badb-8fa338f4e1b9 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:55.523961 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-81f68373-c5e1-4033-badb-8fa338f4e1b9 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:55.524386 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-81f68373-c5e1-4033-badb-8fa338f4e1b9 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:55.657179 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-81f68373-c5e1-4033-badb-8fa338f4e1b9 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:55.665719 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-81f68373-c5e1-4033-badb-8fa338f4e1b9 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1676 microversion: 2.1 time: 0.155191 Oct 18 11:43:55.668744 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 245/471] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:55 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:55.746652 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-e179fae6-9c30-4c40-8ff7-661730c90b6b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:55.747318 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-e179fae6-9c30-4c40-8ff7-661730c90b6b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:55.753997 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e179fae6-9c30-4c40-8ff7-661730c90b6b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:55.754477 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e179fae6-9c30-4c40-8ff7-661730c90b6b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:55.754901 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e179fae6-9c30-4c40-8ff7-661730c90b6b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:55.755589 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e179fae6-9c30-4c40-8ff7-661730c90b6b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:55.756036 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e179fae6-9c30-4c40-8ff7-661730c90b6b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:55.756451 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e179fae6-9c30-4c40-8ff7-661730c90b6b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:55.903931 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-e179fae6-9c30-4c40-8ff7-661730c90b6b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:55.912968 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-e179fae6-9c30-4c40-8ff7-661730c90b6b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:55.914417 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-e179fae6-9c30-4c40-8ff7-661730c90b6b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:55.915590 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-e179fae6-9c30-4c40-8ff7-661730c90b6b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1807 microversion: 2.20 time: 0.172811 Oct 18 11:43:55.916227 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 227/472] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:55 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:43:56.688663 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-2da3d5c2-ec45-461f-9629-dff88675f76b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:56.689316 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-2da3d5c2-ec45-461f-9629-dff88675f76b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:56.697343 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2da3d5c2-ec45-461f-9629-dff88675f76b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:56.698098 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2da3d5c2-ec45-461f-9629-dff88675f76b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:56.698812 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2da3d5c2-ec45-461f-9629-dff88675f76b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:56.699967 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2da3d5c2-ec45-461f-9629-dff88675f76b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:56.700858 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2da3d5c2-ec45-461f-9629-dff88675f76b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:56.701280 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2da3d5c2-ec45-461f-9629-dff88675f76b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:56.841430 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-2da3d5c2-ec45-461f-9629-dff88675f76b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:56.850616 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-2da3d5c2-ec45-461f-9629-dff88675f76b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1676 microversion: 2.1 time: 0.165661 Oct 18 11:43:56.851204 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 246/473] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:56 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:43:56.942118 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-d5cf5f67-ea85-4050-90db-9de9370e8d6e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:56.942714 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-d5cf5f67-ea85-4050-90db-9de9370e8d6e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:56.950637 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d5cf5f67-ea85-4050-90db-9de9370e8d6e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:56.951745 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d5cf5f67-ea85-4050-90db-9de9370e8d6e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:56.952259 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d5cf5f67-ea85-4050-90db-9de9370e8d6e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:56.953316 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d5cf5f67-ea85-4050-90db-9de9370e8d6e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:56.954216 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d5cf5f67-ea85-4050-90db-9de9370e8d6e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:56.954638 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d5cf5f67-ea85-4050-90db-9de9370e8d6e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:57.092717 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-d5cf5f67-ea85-4050-90db-9de9370e8d6e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:57.096294 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:43:57.102710 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-d5cf5f67-ea85-4050-90db-9de9370e8d6e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:57.104145 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-d5cf5f67-ea85-4050-90db-9de9370e8d6e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:57.105348 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-d5cf5f67-ea85-4050-90db-9de9370e8d6e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1807 microversion: 2.20 time: 0.167391 Oct 18 11:43:57.105900 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 228/474] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:56 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:43:57.873740 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-f9f17412-5a01-4d02-a519-77d33c319d52 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:57.874334 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-f9f17412-5a01-4d02-a519-77d33c319d52 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:57.881308 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f9f17412-5a01-4d02-a519-77d33c319d52 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:57.882338 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f9f17412-5a01-4d02-a519-77d33c319d52 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:57.882793 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f9f17412-5a01-4d02-a519-77d33c319d52 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:57.884221 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f9f17412-5a01-4d02-a519-77d33c319d52 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:57.885195 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f9f17412-5a01-4d02-a519-77d33c319d52 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:57.885734 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f9f17412-5a01-4d02-a519-77d33c319d52 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:58.024266 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-f9f17412-5a01-4d02-a519-77d33c319d52 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:58.032150 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-f9f17412-5a01-4d02-a519-77d33c319d52 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1676 microversion: 2.1 time: 0.162221 Oct 18 11:43:58.032715 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 247/475] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:57 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:58.131539 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-2165840f-f863-428c-a590-06ca6f90eea5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:58.132240 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-2165840f-f863-428c-a590-06ca6f90eea5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:58.139904 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2165840f-f863-428c-a590-06ca6f90eea5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:58.140480 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2165840f-f863-428c-a590-06ca6f90eea5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:58.141004 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2165840f-f863-428c-a590-06ca6f90eea5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:58.141753 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2165840f-f863-428c-a590-06ca6f90eea5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:58.142268 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2165840f-f863-428c-a590-06ca6f90eea5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:58.142688 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2165840f-f863-428c-a590-06ca6f90eea5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:58.298748 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-2165840f-f863-428c-a590-06ca6f90eea5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:58.308286 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-2165840f-f863-428c-a590-06ca6f90eea5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:58.309938 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-2165840f-f863-428c-a590-06ca6f90eea5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:58.311113 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-2165840f-f863-428c-a590-06ca6f90eea5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1807 microversion: 2.20 time: 0.184036 Oct 18 11:43:58.311990 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 229/476] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:58 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:43:59.055943 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-eb81e14f-e484-4fe4-9ef3-5a9f290f3711 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:59.056632 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-eb81e14f-e484-4fe4-9ef3-5a9f290f3711 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:59.063560 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-eb81e14f-e484-4fe4-9ef3-5a9f290f3711 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:59.064234 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-eb81e14f-e484-4fe4-9ef3-5a9f290f3711 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:59.068563 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-eb81e14f-e484-4fe4-9ef3-5a9f290f3711 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:59.068563 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-eb81e14f-e484-4fe4-9ef3-5a9f290f3711 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:59.068563 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-eb81e14f-e484-4fe4-9ef3-5a9f290f3711 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:59.068563 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-eb81e14f-e484-4fe4-9ef3-5a9f290f3711 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:59.206696 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-eb81e14f-e484-4fe4-9ef3-5a9f290f3711 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:59.216617 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-eb81e14f-e484-4fe4-9ef3-5a9f290f3711 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1676 microversion: 2.1 time: 0.164873 Oct 18 11:43:59.220185 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 248/477] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:43:59 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:43:59.338005 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-3594cb72-d59a-4a33-96a2-b7763e959b56 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:43:59.338972 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-3594cb72-d59a-4a33-96a2-b7763e959b56 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:43:59.344966 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3594cb72-d59a-4a33-96a2-b7763e959b56 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:59.345457 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3594cb72-d59a-4a33-96a2-b7763e959b56 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:59.345991 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3594cb72-d59a-4a33-96a2-b7763e959b56 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:59.347013 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3594cb72-d59a-4a33-96a2-b7763e959b56 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:43:59.347620 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3594cb72-d59a-4a33-96a2-b7763e959b56 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:43:59.348118 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3594cb72-d59a-4a33-96a2-b7763e959b56 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:43:59.501615 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-3594cb72-d59a-4a33-96a2-b7763e959b56 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:59.510989 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-3594cb72-d59a-4a33-96a2-b7763e959b56 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:59.512465 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-3594cb72-d59a-4a33-96a2-b7763e959b56 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:43:59.513907 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-3594cb72-d59a-4a33-96a2-b7763e959b56 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1807 microversion: 2.20 time: 0.180176 Oct 18 11:43:59.514650 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 230/478] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:43:59 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:44:00.243155 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-0ab93aad-5556-4629-bf96-1453a81edf01 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:00.243826 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-0ab93aad-5556-4629-bf96-1453a81edf01 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:00.250512 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0ab93aad-5556-4629-bf96-1453a81edf01 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:00.250986 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0ab93aad-5556-4629-bf96-1453a81edf01 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:00.251413 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0ab93aad-5556-4629-bf96-1453a81edf01 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:00.252102 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0ab93aad-5556-4629-bf96-1453a81edf01 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:00.252543 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0ab93aad-5556-4629-bf96-1453a81edf01 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:00.252979 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0ab93aad-5556-4629-bf96-1453a81edf01 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:00.392174 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-0ab93aad-5556-4629-bf96-1453a81edf01 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:00.400242 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-0ab93aad-5556-4629-bf96-1453a81edf01 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1676 microversion: 2.1 time: 0.163239 Oct 18 11:44:00.400825 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 249/479] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:00 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:00.539737 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-94090129-5a1f-4e02-832b-4f7c49cb4417 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:00.540306 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-94090129-5a1f-4e02-832b-4f7c49cb4417 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:00.546823 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-94090129-5a1f-4e02-832b-4f7c49cb4417 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:00.547307 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-94090129-5a1f-4e02-832b-4f7c49cb4417 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:00.547949 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-94090129-5a1f-4e02-832b-4f7c49cb4417 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:00.548879 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-94090129-5a1f-4e02-832b-4f7c49cb4417 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:00.549344 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-94090129-5a1f-4e02-832b-4f7c49cb4417 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:00.549767 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-94090129-5a1f-4e02-832b-4f7c49cb4417 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:00.694716 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-94090129-5a1f-4e02-832b-4f7c49cb4417 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:00.707838 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-94090129-5a1f-4e02-832b-4f7c49cb4417 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:00.709481 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-94090129-5a1f-4e02-832b-4f7c49cb4417 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:00.711285 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-94090129-5a1f-4e02-832b-4f7c49cb4417 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1807 microversion: 2.20 time: 0.175537 Oct 18 11:44:00.712038 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 231/480] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:44:00 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:44:01.424980 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-c7ecaa63-2875-4ed9-99aa-9b0d488b0411 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:01.425575 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-c7ecaa63-2875-4ed9-99aa-9b0d488b0411 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:01.431858 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c7ecaa63-2875-4ed9-99aa-9b0d488b0411 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:01.432331 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c7ecaa63-2875-4ed9-99aa-9b0d488b0411 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:01.432755 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c7ecaa63-2875-4ed9-99aa-9b0d488b0411 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:01.433459 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c7ecaa63-2875-4ed9-99aa-9b0d488b0411 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:01.433902 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c7ecaa63-2875-4ed9-99aa-9b0d488b0411 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:01.434314 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c7ecaa63-2875-4ed9-99aa-9b0d488b0411 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:01.562573 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-c7ecaa63-2875-4ed9-99aa-9b0d488b0411 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:01.570699 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-c7ecaa63-2875-4ed9-99aa-9b0d488b0411 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1676 microversion: 2.1 time: 0.149064 Oct 18 11:44:01.571249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 250/481] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:01 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:01.736811 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-1cbe8e28-caf3-4fcc-ab86-998ffeac0782 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:01.737435 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-1cbe8e28-caf3-4fcc-ab86-998ffeac0782 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:01.743832 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1cbe8e28-caf3-4fcc-ab86-998ffeac0782 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:01.744304 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1cbe8e28-caf3-4fcc-ab86-998ffeac0782 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:01.744725 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1cbe8e28-caf3-4fcc-ab86-998ffeac0782 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:01.745422 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1cbe8e28-caf3-4fcc-ab86-998ffeac0782 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:01.745865 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1cbe8e28-caf3-4fcc-ab86-998ffeac0782 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:01.746278 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1cbe8e28-caf3-4fcc-ab86-998ffeac0782 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:01.883537 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-1cbe8e28-caf3-4fcc-ab86-998ffeac0782 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:01.892067 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-1cbe8e28-caf3-4fcc-ab86-998ffeac0782 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:01.893515 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-1cbe8e28-caf3-4fcc-ab86-998ffeac0782 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:01.894662 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-1cbe8e28-caf3-4fcc-ab86-998ffeac0782 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1807 microversion: 2.20 time: 0.161763 Oct 18 11:44:01.895209 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 232/482] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:44:01 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:44:02.596332 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-0f7c091f-2515-428c-9ed4-0216427c49a0 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:02.596901 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-0f7c091f-2515-428c-9ed4-0216427c49a0 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:02.603869 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0f7c091f-2515-428c-9ed4-0216427c49a0 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:02.604333 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0f7c091f-2515-428c-9ed4-0216427c49a0 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:02.604756 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0f7c091f-2515-428c-9ed4-0216427c49a0 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:02.605469 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0f7c091f-2515-428c-9ed4-0216427c49a0 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:02.605914 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0f7c091f-2515-428c-9ed4-0216427c49a0 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:02.606329 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0f7c091f-2515-428c-9ed4-0216427c49a0 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:02.738973 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-0f7c091f-2515-428c-9ed4-0216427c49a0 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:02.746663 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-0f7c091f-2515-428c-9ed4-0216427c49a0 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1653 microversion: 2.1 time: 0.156325 Oct 18 11:44:02.747225 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 251/483] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:02 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1653 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:02.769021 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-54d3d233-6437-4d6d-8daa-c7ba8e4727f3 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:44:02.776052 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-54d3d233-6437-4d6d-8daa-c7ba8e4727f3 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:02.776530 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-54d3d233-6437-4d6d-8daa-c7ba8e4727f3 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:02.776999 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-54d3d233-6437-4d6d-8daa-c7ba8e4727f3 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:02.799049 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-54d3d233-6437-4d6d-8daa-c7ba8e4727f3 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Going to try to start instance {{(pid=125486) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 18 11:44:02.840244 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-54d3d233-6437-4d6d-8daa-c7ba8e4727f3 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "POST /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781/action" status: 202 len: 0 microversion: 2.1 time: 0.074978 Oct 18 11:44:02.840834 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 233/484] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Oct 18 11:44:02 2022] POST /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 11:44:02.849274 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-7c4e29f3-1d7c-4e65-a4bf-35e1b7eafe92 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:02.849817 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-7c4e29f3-1d7c-4e65-a4bf-35e1b7eafe92 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:02.856409 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7c4e29f3-1d7c-4e65-a4bf-35e1b7eafe92 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:02.856944 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7c4e29f3-1d7c-4e65-a4bf-35e1b7eafe92 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:02.857383 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7c4e29f3-1d7c-4e65-a4bf-35e1b7eafe92 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:02.858079 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7c4e29f3-1d7c-4e65-a4bf-35e1b7eafe92 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:02.858527 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7c4e29f3-1d7c-4e65-a4bf-35e1b7eafe92 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:02.858940 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7c4e29f3-1d7c-4e65-a4bf-35e1b7eafe92 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:02.921761 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-f2421797-0290-4d1d-ab79-4cd0f7aab96b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:02.922452 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-f2421797-0290-4d1d-ab79-4cd0f7aab96b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:02.928917 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f2421797-0290-4d1d-ab79-4cd0f7aab96b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:02.929403 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f2421797-0290-4d1d-ab79-4cd0f7aab96b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:02.929828 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f2421797-0290-4d1d-ab79-4cd0f7aab96b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:02.930522 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f2421797-0290-4d1d-ab79-4cd0f7aab96b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:02.930962 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f2421797-0290-4d1d-ab79-4cd0f7aab96b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:02.931373 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f2421797-0290-4d1d-ab79-4cd0f7aab96b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:02.994487 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-7c4e29f3-1d7c-4e65-a4bf-35e1b7eafe92 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:03.002377 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-7c4e29f3-1d7c-4e65-a4bf-35e1b7eafe92 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1662 microversion: 2.1 time: 0.157157 Oct 18 11:44:03.002956 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 252/485] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:02 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1662 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:03.143355 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-f2421797-0290-4d1d-ab79-4cd0f7aab96b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:03.153327 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-f2421797-0290-4d1d-ab79-4cd0f7aab96b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:03.154794 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-f2421797-0290-4d1d-ab79-4cd0f7aab96b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:03.155963 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-f2421797-0290-4d1d-ab79-4cd0f7aab96b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1807 microversion: 2.20 time: 0.238637 Oct 18 11:44:03.156516 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 234/486] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:44:02 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1807 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:44:04.026014 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-67395d4e-3f9c-4bf0-b875-2b85a4adad24 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:04.026657 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-67395d4e-3f9c-4bf0-b875-2b85a4adad24 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:04.028996 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:44:04.034273 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-67395d4e-3f9c-4bf0-b875-2b85a4adad24 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:04.034752 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-67395d4e-3f9c-4bf0-b875-2b85a4adad24 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:04.035182 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-67395d4e-3f9c-4bf0-b875-2b85a4adad24 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:04.035864 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-67395d4e-3f9c-4bf0-b875-2b85a4adad24 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:04.036308 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-67395d4e-3f9c-4bf0-b875-2b85a4adad24 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:04.036721 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-67395d4e-3f9c-4bf0-b875-2b85a4adad24 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:04.165092 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-67395d4e-3f9c-4bf0-b875-2b85a4adad24 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:04.172873 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-67395d4e-3f9c-4bf0-b875-2b85a4adad24 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1662 microversion: 2.1 time: 0.151335 Oct 18 11:44:04.173437 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 253/487] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:04 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1662 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:04.181879 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-0fb9f40d-7246-4bf8-9bf6-773480069ff9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:04.182481 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-0fb9f40d-7246-4bf8-9bf6-773480069ff9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:04.188887 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0fb9f40d-7246-4bf8-9bf6-773480069ff9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:04.189366 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0fb9f40d-7246-4bf8-9bf6-773480069ff9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:04.189792 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0fb9f40d-7246-4bf8-9bf6-773480069ff9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:04.190496 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0fb9f40d-7246-4bf8-9bf6-773480069ff9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:04.190939 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0fb9f40d-7246-4bf8-9bf6-773480069ff9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:04.191350 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0fb9f40d-7246-4bf8-9bf6-773480069ff9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:04.317514 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-0fb9f40d-7246-4bf8-9bf6-773480069ff9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:04.326774 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-0fb9f40d-7246-4bf8-9bf6-773480069ff9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:04.328196 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-0fb9f40d-7246-4bf8-9bf6-773480069ff9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:04.329382 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-0fb9f40d-7246-4bf8-9bf6-773480069ff9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1807 microversion: 2.20 time: 0.151875 Oct 18 11:44:04.329943 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 235/488] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:44:04 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:44:04.885748 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-72d6a09d-6677-4213-876d-07d4d5edbbbc tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58fb065d-ccab-4904-98fe-c598c0060524"}} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:44:04.888128 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-72d6a09d-6677-4213-876d-07d4d5edbbbc tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:04.894009 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-72d6a09d-6677-4213-876d-07d4d5edbbbc tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:04.894487 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-72d6a09d-6677-4213-876d-07d4d5edbbbc tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:04.894918 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-72d6a09d-6677-4213-876d-07d4d5edbbbc tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:04.895596 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-72d6a09d-6677-4213-876d-07d4d5edbbbc tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:04.896043 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-72d6a09d-6677-4213-876d-07d4d5edbbbc tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:04.896461 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-72d6a09d-6677-4213-876d-07d4d5edbbbc tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:05.135044 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-72d6a09d-6677-4213-876d-07d4d5edbbbc tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "POST /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253126 Oct 18 11:44:05.135860 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 254/489] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Oct 18 11:44:04 2022] POST /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:44:05.201478 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-0ff4275c-ba8c-4ee6-abee-958098436733 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:05.203073 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-0ff4275c-ba8c-4ee6-abee-958098436733 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:05.209254 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0ff4275c-ba8c-4ee6-abee-958098436733 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:05.209993 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0ff4275c-ba8c-4ee6-abee-958098436733 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:05.210951 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0ff4275c-ba8c-4ee6-abee-958098436733 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:05.211639 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0ff4275c-ba8c-4ee6-abee-958098436733 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:05.212082 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0ff4275c-ba8c-4ee6-abee-958098436733 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:05.212501 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0ff4275c-ba8c-4ee6-abee-958098436733 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:05.347604 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-0ff4275c-ba8c-4ee6-abee-958098436733 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:05.355389 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-0ff4275c-ba8c-4ee6-abee-958098436733 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1666 microversion: 2.1 time: 0.157825 Oct 18 11:44:05.355873 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-11dd484e-6401-4e1c-915c-7b179da38557 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:05.355980 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 236/490] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:05 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1666 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:05.356690 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-11dd484e-6401-4e1c-915c-7b179da38557 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:05.362862 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-11dd484e-6401-4e1c-915c-7b179da38557 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:05.363340 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-11dd484e-6401-4e1c-915c-7b179da38557 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:05.363784 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-11dd484e-6401-4e1c-915c-7b179da38557 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:05.364533 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-11dd484e-6401-4e1c-915c-7b179da38557 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:05.364958 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-11dd484e-6401-4e1c-915c-7b179da38557 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:05.365377 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-11dd484e-6401-4e1c-915c-7b179da38557 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:05.500618 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-11dd484e-6401-4e1c-915c-7b179da38557 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:05.509750 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-11dd484e-6401-4e1c-915c-7b179da38557 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:05.511187 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-11dd484e-6401-4e1c-915c-7b179da38557 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:05.512346 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-11dd484e-6401-4e1c-915c-7b179da38557 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1807 microversion: 2.20 time: 0.161246 Oct 18 11:44:05.512920 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 255/491] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:44:05 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:44:06.538320 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-24814d89-2a08-4757-9b4d-003ead68d170 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:06.539438 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-24814d89-2a08-4757-9b4d-003ead68d170 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:06.541853 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_api:SELECT=50 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:44:06.547307 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-24814d89-2a08-4757-9b4d-003ead68d170 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:06.547788 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-24814d89-2a08-4757-9b4d-003ead68d170 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:06.548216 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-24814d89-2a08-4757-9b4d-003ead68d170 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:06.548928 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-24814d89-2a08-4757-9b4d-003ead68d170 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:06.549383 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-24814d89-2a08-4757-9b4d-003ead68d170 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:06.549802 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-24814d89-2a08-4757-9b4d-003ead68d170 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:06.676506 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-24814d89-2a08-4757-9b4d-003ead68d170 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:06.685051 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-24814d89-2a08-4757-9b4d-003ead68d170 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:06.686492 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-24814d89-2a08-4757-9b4d-003ead68d170 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:06.687641 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-24814d89-2a08-4757-9b4d-003ead68d170 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1807 microversion: 2.20 time: 0.153381 Oct 18 11:44:06.688191 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 237/492] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:44:06 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:44:07.712942 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-fbf0080a-5491-4e2d-9ac0-d6fb6d231c65 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:07.713543 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-fbf0080a-5491-4e2d-9ac0-d6fb6d231c65 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:07.719938 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fbf0080a-5491-4e2d-9ac0-d6fb6d231c65 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:07.720408 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fbf0080a-5491-4e2d-9ac0-d6fb6d231c65 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:07.720835 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fbf0080a-5491-4e2d-9ac0-d6fb6d231c65 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:07.721529 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fbf0080a-5491-4e2d-9ac0-d6fb6d231c65 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:07.721966 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fbf0080a-5491-4e2d-9ac0-d6fb6d231c65 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:07.722377 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fbf0080a-5491-4e2d-9ac0-d6fb6d231c65 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:07.849651 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-fbf0080a-5491-4e2d-9ac0-d6fb6d231c65 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:07.858718 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-fbf0080a-5491-4e2d-9ac0-d6fb6d231c65 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:07.860134 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-fbf0080a-5491-4e2d-9ac0-d6fb6d231c65 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:07.861306 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-fbf0080a-5491-4e2d-9ac0-d6fb6d231c65 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1807 microversion: 2.20 time: 0.152576 Oct 18 11:44:07.861854 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 256/493] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:44:07 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:44:08.886297 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-fb6ffa00-b5e8-48c3-b0d6-f0705787339f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:08.886978 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-fb6ffa00-b5e8-48c3-b0d6-f0705787339f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:08.893608 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fb6ffa00-b5e8-48c3-b0d6-f0705787339f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:08.894085 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fb6ffa00-b5e8-48c3-b0d6-f0705787339f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:08.894517 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fb6ffa00-b5e8-48c3-b0d6-f0705787339f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:08.895201 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fb6ffa00-b5e8-48c3-b0d6-f0705787339f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:08.895651 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fb6ffa00-b5e8-48c3-b0d6-f0705787339f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:08.896071 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fb6ffa00-b5e8-48c3-b0d6-f0705787339f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:09.026784 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-fb6ffa00-b5e8-48c3-b0d6-f0705787339f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:09.035467 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-fb6ffa00-b5e8-48c3-b0d6-f0705787339f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:09.036945 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-fb6ffa00-b5e8-48c3-b0d6-f0705787339f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:09.038096 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-fb6ffa00-b5e8-48c3-b0d6-f0705787339f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1807 microversion: 2.20 time: 0.155735 Oct 18 11:44:09.038656 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 238/494] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:44:08 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:44:10.063883 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-5bbdbde5-d2c0-4213-98fe-8f7fb7ac9a6d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:10.064475 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-5bbdbde5-d2c0-4213-98fe-8f7fb7ac9a6d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:10.071375 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5bbdbde5-d2c0-4213-98fe-8f7fb7ac9a6d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:10.071850 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5bbdbde5-d2c0-4213-98fe-8f7fb7ac9a6d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:10.072282 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5bbdbde5-d2c0-4213-98fe-8f7fb7ac9a6d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:10.073008 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5bbdbde5-d2c0-4213-98fe-8f7fb7ac9a6d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:10.073457 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5bbdbde5-d2c0-4213-98fe-8f7fb7ac9a6d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:10.073874 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5bbdbde5-d2c0-4213-98fe-8f7fb7ac9a6d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:10.206163 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-5bbdbde5-d2c0-4213-98fe-8f7fb7ac9a6d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:10.215041 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-5bbdbde5-d2c0-4213-98fe-8f7fb7ac9a6d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:10.216464 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-5bbdbde5-d2c0-4213-98fe-8f7fb7ac9a6d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:10.217640 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-5bbdbde5-d2c0-4213-98fe-8f7fb7ac9a6d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1807 microversion: 2.20 time: 0.157779 Oct 18 11:44:10.218190 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 257/495] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:44:10 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:44:11.242642 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-61153301-7845-4da0-9bfb-0a410f6d4d23 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:11.243245 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-61153301-7845-4da0-9bfb-0a410f6d4d23 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:11.249704 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-61153301-7845-4da0-9bfb-0a410f6d4d23 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:11.250189 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-61153301-7845-4da0-9bfb-0a410f6d4d23 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:11.250616 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-61153301-7845-4da0-9bfb-0a410f6d4d23 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:11.251332 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-61153301-7845-4da0-9bfb-0a410f6d4d23 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:11.251777 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-61153301-7845-4da0-9bfb-0a410f6d4d23 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:11.252194 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-61153301-7845-4da0-9bfb-0a410f6d4d23 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:11.384234 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-61153301-7845-4da0-9bfb-0a410f6d4d23 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:11.392946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-61153301-7845-4da0-9bfb-0a410f6d4d23 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:11.394383 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-61153301-7845-4da0-9bfb-0a410f6d4d23 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:11.395532 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-61153301-7845-4da0-9bfb-0a410f6d4d23 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1807 microversion: 2.20 time: 0.156968 Oct 18 11:44:11.396087 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 239/496] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:44:11 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:44:12.420391 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-e64ace0d-c5e6-4618-a43f-d9fb3b99f356 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:12.421019 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-e64ace0d-c5e6-4618-a43f-d9fb3b99f356 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:12.427343 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e64ace0d-c5e6-4618-a43f-d9fb3b99f356 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:12.427819 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e64ace0d-c5e6-4618-a43f-d9fb3b99f356 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:12.428253 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e64ace0d-c5e6-4618-a43f-d9fb3b99f356 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:12.428961 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e64ace0d-c5e6-4618-a43f-d9fb3b99f356 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:12.429409 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e64ace0d-c5e6-4618-a43f-d9fb3b99f356 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:12.429822 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e64ace0d-c5e6-4618-a43f-d9fb3b99f356 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:12.557284 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-e64ace0d-c5e6-4618-a43f-d9fb3b99f356 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:12.565873 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-e64ace0d-c5e6-4618-a43f-d9fb3b99f356 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:12.567337 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-e64ace0d-c5e6-4618-a43f-d9fb3b99f356 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:12.568492 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-e64ace0d-c5e6-4618-a43f-d9fb3b99f356 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1807 microversion: 2.20 time: 0.152060 Oct 18 11:44:12.569088 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 258/497] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:44:12 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:44:12.672581 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-b6764a09-4674-4cb2-a2a1-ee6e5e30adde tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:44:12.675093 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-b6764a09-4674-4cb2-a2a1-ee6e5e30adde tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:12.681800 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b6764a09-4674-4cb2-a2a1-ee6e5e30adde tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:12.682279 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b6764a09-4674-4cb2-a2a1-ee6e5e30adde tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:12.682703 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b6764a09-4674-4cb2-a2a1-ee6e5e30adde tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:12.683387 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b6764a09-4674-4cb2-a2a1-ee6e5e30adde tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:12.683830 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b6764a09-4674-4cb2-a2a1-ee6e5e30adde tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:12.684245 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b6764a09-4674-4cb2-a2a1-ee6e5e30adde tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:12.707121 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.objects.instance [None req-b6764a09-4674-4cb2-a2a1-ee6e5e30adde tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lazy-loading 'flavor' on Instance uuid 3f737271-603e-4448-b37d-4a5ae83dd052 {{(pid=125486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:44:12.777770 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-4d08c80f-14a7-4135-b2e4-237c8cf0d869 req-604baa3d-25a4-45dc-a847-737b1a8a9975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2b9dfa2-7553-47cd-8274-6a0004bac79d", "name": "network-vif-plugged", "status": "completed", "tag": "03f3558a-e868-4501-8139-30b9edad14e0"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:44:12.788560 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-4d08c80f-14a7-4135-b2e4-237c8cf0d869 req-604baa3d-25a4-45dc-a847-737b1a8a9975 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:12.789230 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-4d08c80f-14a7-4135-b2e4-237c8cf0d869 req-604baa3d-25a4-45dc-a847-737b1a8a9975 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:12.789661 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-4d08c80f-14a7-4135-b2e4-237c8cf0d869 req-604baa3d-25a4-45dc-a847-737b1a8a9975 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:12.802155 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-4d08c80f-14a7-4135-b2e4-237c8cf0d869 req-604baa3d-25a4-45dc-a847-737b1a8a9975 service nova] Creating event network-vif-plugged:03f3558a-e868-4501-8139-30b9edad14e0 for instance a2b9dfa2-7553-47cd-8274-6a0004bac79d on hv-cinder-81558 Oct 18 11:44:12.807313 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-4d08c80f-14a7-4135-b2e4-237c8cf0d869 req-604baa3d-25a4-45dc-a847-737b1a8a9975 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035821 Oct 18 11:44:12.808369 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 259/498] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:44:12.847438 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-b6764a09-4674-4cb2-a2a1-ee6e5e30adde tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "POST /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052/action" status: 200 len: 32 microversion: 2.1 time: 0.178679 Oct 18 11:44:12.848064 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 240/499] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Oct 18 11:44:12 2022] POST /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 11:44:12.858579 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-04760bb0-e6c0-490b-8170-b6a9c2a8919a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:12.859443 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-04760bb0-e6c0-490b-8170-b6a9c2a8919a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:12.866100 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-04760bb0-e6c0-490b-8170-b6a9c2a8919a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:12.866579 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-04760bb0-e6c0-490b-8170-b6a9c2a8919a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:12.867016 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-04760bb0-e6c0-490b-8170-b6a9c2a8919a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:12.867712 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-04760bb0-e6c0-490b-8170-b6a9c2a8919a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:12.868341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-04760bb0-e6c0-490b-8170-b6a9c2a8919a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:12.869060 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-04760bb0-e6c0-490b-8170-b6a9c2a8919a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:12.888745 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:44:13.002048 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-04760bb0-e6c0-490b-8170-b6a9c2a8919a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:13.010830 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-04760bb0-e6c0-490b-8170-b6a9c2a8919a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1735 microversion: 2.1 time: 0.156824 Oct 18 11:44:13.011329 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 260/500] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:12 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:44:13.595676 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-7c04b2fd-dcad-4c2f-aca5-75cce5fee6df tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:13.596269 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-7c04b2fd-dcad-4c2f-aca5-75cce5fee6df tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:13.603045 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7c04b2fd-dcad-4c2f-aca5-75cce5fee6df tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:13.603510 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7c04b2fd-dcad-4c2f-aca5-75cce5fee6df tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:13.603935 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7c04b2fd-dcad-4c2f-aca5-75cce5fee6df tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:13.604603 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7c04b2fd-dcad-4c2f-aca5-75cce5fee6df tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:13.605078 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7c04b2fd-dcad-4c2f-aca5-75cce5fee6df tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:13.605492 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7c04b2fd-dcad-4c2f-aca5-75cce5fee6df tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:13.747229 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-7c04b2fd-dcad-4c2f-aca5-75cce5fee6df tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:13.757236 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-7c04b2fd-dcad-4c2f-aca5-75cce5fee6df tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:13.758688 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-7c04b2fd-dcad-4c2f-aca5-75cce5fee6df tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:13.759879 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-7c04b2fd-dcad-4c2f-aca5-75cce5fee6df tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1807 microversion: 2.20 time: 0.168539 Oct 18 11:44:13.760444 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 241/501] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:44:13 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:44:14.033758 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-4f2b10e9-d8df-4537-b3cc-7e6e4687e30e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:14.034488 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-4f2b10e9-d8df-4537-b3cc-7e6e4687e30e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:14.041480 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4f2b10e9-d8df-4537-b3cc-7e6e4687e30e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:14.041965 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4f2b10e9-d8df-4537-b3cc-7e6e4687e30e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:14.042558 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4f2b10e9-d8df-4537-b3cc-7e6e4687e30e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:14.043251 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4f2b10e9-d8df-4537-b3cc-7e6e4687e30e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:14.043702 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4f2b10e9-d8df-4537-b3cc-7e6e4687e30e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:14.044151 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4f2b10e9-d8df-4537-b3cc-7e6e4687e30e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:14.176054 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-4f2b10e9-d8df-4537-b3cc-7e6e4687e30e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:14.184330 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-4f2b10e9-d8df-4537-b3cc-7e6e4687e30e tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1735 microversion: 2.1 time: 0.154376 Oct 18 11:44:14.184908 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 261/502] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:14 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:14.785750 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-a2a78f92-e0f4-4245-ae66-32a0606d48fe tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:14.786335 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-a2a78f92-e0f4-4245-ae66-32a0606d48fe tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:14.792734 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a2a78f92-e0f4-4245-ae66-32a0606d48fe tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:14.793245 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a2a78f92-e0f4-4245-ae66-32a0606d48fe tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:14.793667 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a2a78f92-e0f4-4245-ae66-32a0606d48fe tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:14.794347 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a2a78f92-e0f4-4245-ae66-32a0606d48fe tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:14.794788 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a2a78f92-e0f4-4245-ae66-32a0606d48fe tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:14.795201 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a2a78f92-e0f4-4245-ae66-32a0606d48fe tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:14.813166 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:44:14.933630 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-a2a78f92-e0f4-4245-ae66-32a0606d48fe tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:14.943241 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-a2a78f92-e0f4-4245-ae66-32a0606d48fe tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:14.945308 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-a2a78f92-e0f4-4245-ae66-32a0606d48fe tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:14.946920 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-a2a78f92-e0f4-4245-ae66-32a0606d48fe tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1807 microversion: 2.20 time: 0.165449 Oct 18 11:44:14.947476 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 242/503] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:44:14 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:44:15.207484 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-95d5efce-d9ab-4cc0-95c6-631ce28e37a9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:15.208287 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-95d5efce-d9ab-4cc0-95c6-631ce28e37a9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:15.215244 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-95d5efce-d9ab-4cc0-95c6-631ce28e37a9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:15.215950 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-95d5efce-d9ab-4cc0-95c6-631ce28e37a9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:15.216382 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-95d5efce-d9ab-4cc0-95c6-631ce28e37a9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:15.217107 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-95d5efce-d9ab-4cc0-95c6-631ce28e37a9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:15.217557 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-95d5efce-d9ab-4cc0-95c6-631ce28e37a9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:15.217981 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-95d5efce-d9ab-4cc0-95c6-631ce28e37a9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:15.359046 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-95d5efce-d9ab-4cc0-95c6-631ce28e37a9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:15.367485 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-95d5efce-d9ab-4cc0-95c6-631ce28e37a9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1735 microversion: 2.1 time: 0.163778 Oct 18 11:44:15.368380 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 262/504] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:15 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:15.389621 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-d9300a7d-4a11-4687-8e25-85cdb6d5948f tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:44:15.392044 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-d9300a7d-4a11-4687-8e25-85cdb6d5948f tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:15.398518 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d9300a7d-4a11-4687-8e25-85cdb6d5948f tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:15.398999 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d9300a7d-4a11-4687-8e25-85cdb6d5948f tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:15.399429 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d9300a7d-4a11-4687-8e25-85cdb6d5948f tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:15.400120 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d9300a7d-4a11-4687-8e25-85cdb6d5948f tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:15.400568 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d9300a7d-4a11-4687-8e25-85cdb6d5948f tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:15.401018 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d9300a7d-4a11-4687-8e25-85cdb6d5948f tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:15.474101 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-d9300a7d-4a11-4687-8e25-85cdb6d5948f tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "POST /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e/action" status: 202 len: 0 microversion: 2.1 time: 0.088241 Oct 18 11:44:15.474724 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 243/505] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Oct 18 11:44:15 2022] POST /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 11:44:15.483519 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-d8ea3f07-4ccd-4e48-8b74-b09c75e8b0f0 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:15.484130 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-d8ea3f07-4ccd-4e48-8b74-b09c75e8b0f0 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:15.490014 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d8ea3f07-4ccd-4e48-8b74-b09c75e8b0f0 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:15.490490 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d8ea3f07-4ccd-4e48-8b74-b09c75e8b0f0 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:15.490922 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d8ea3f07-4ccd-4e48-8b74-b09c75e8b0f0 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:15.491629 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d8ea3f07-4ccd-4e48-8b74-b09c75e8b0f0 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:15.492077 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d8ea3f07-4ccd-4e48-8b74-b09c75e8b0f0 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:15.492497 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d8ea3f07-4ccd-4e48-8b74-b09c75e8b0f0 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:15.650153 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-d8ea3f07-4ccd-4e48-8b74-b09c75e8b0f0 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:15.660195 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-d8ea3f07-4ccd-4e48-8b74-b09c75e8b0f0 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1751 microversion: 2.1 time: 0.180344 Oct 18 11:44:15.661126 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 263/506] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:15 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:15.972112 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-f46163d0-3a7c-426a-aab1-3266bdedab4a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:15.972796 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-f46163d0-3a7c-426a-aab1-3266bdedab4a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:15.979832 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f46163d0-3a7c-426a-aab1-3266bdedab4a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:15.980306 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f46163d0-3a7c-426a-aab1-3266bdedab4a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:15.980740 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f46163d0-3a7c-426a-aab1-3266bdedab4a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:15.981451 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f46163d0-3a7c-426a-aab1-3266bdedab4a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:15.981893 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f46163d0-3a7c-426a-aab1-3266bdedab4a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:15.982314 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f46163d0-3a7c-426a-aab1-3266bdedab4a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:16.188280 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-f46163d0-3a7c-426a-aab1-3266bdedab4a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:16.197171 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-f46163d0-3a7c-426a-aab1-3266bdedab4a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:16.198627 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-f46163d0-3a7c-426a-aab1-3266bdedab4a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:16.199796 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-f46163d0-3a7c-426a-aab1-3266bdedab4a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1794 microversion: 2.20 time: 0.231968 Oct 18 11:44:16.200346 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 244/507] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:44:15 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1794 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:44:16.390986 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-7dd94009-06b6-4d9f-8d7e-6093114cc80b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:16.391694 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-7dd94009-06b6-4d9f-8d7e-6093114cc80b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:16.398827 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7dd94009-06b6-4d9f-8d7e-6093114cc80b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:16.399349 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7dd94009-06b6-4d9f-8d7e-6093114cc80b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:16.399776 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7dd94009-06b6-4d9f-8d7e-6093114cc80b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:16.400506 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7dd94009-06b6-4d9f-8d7e-6093114cc80b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:16.400980 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7dd94009-06b6-4d9f-8d7e-6093114cc80b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:16.401399 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7dd94009-06b6-4d9f-8d7e-6093114cc80b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:16.531269 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-7dd94009-06b6-4d9f-8d7e-6093114cc80b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:16.539809 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-7dd94009-06b6-4d9f-8d7e-6093114cc80b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1735 microversion: 2.1 time: 0.152809 Oct 18 11:44:16.540357 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 264/508] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:16 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:16.684229 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-becbd9c9-30e7-4304-9dbb-1f8634bb71ce tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:16.684859 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-becbd9c9-30e7-4304-9dbb-1f8634bb71ce tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:16.690788 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-becbd9c9-30e7-4304-9dbb-1f8634bb71ce tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:16.691268 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-becbd9c9-30e7-4304-9dbb-1f8634bb71ce tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:16.691697 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-becbd9c9-30e7-4304-9dbb-1f8634bb71ce tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:16.692376 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-becbd9c9-30e7-4304-9dbb-1f8634bb71ce tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:16.692819 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-becbd9c9-30e7-4304-9dbb-1f8634bb71ce tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:16.693276 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-becbd9c9-30e7-4304-9dbb-1f8634bb71ce tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:16.836740 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-becbd9c9-30e7-4304-9dbb-1f8634bb71ce tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:16.845033 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-becbd9c9-30e7-4304-9dbb-1f8634bb71ce tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1756 microversion: 2.1 time: 0.164802 Oct 18 11:44:16.845596 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 245/509] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:16 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:17.092326 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-b02578d4-ccae-4594-afb0-93da88c62e1d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:17.092734 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-b02578d4-ccae-4594-afb0-93da88c62e1d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:17.098600 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b02578d4-ccae-4594-afb0-93da88c62e1d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:17.099074 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b02578d4-ccae-4594-afb0-93da88c62e1d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:17.099500 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b02578d4-ccae-4594-afb0-93da88c62e1d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:17.100176 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b02578d4-ccae-4594-afb0-93da88c62e1d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:17.101378 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b02578d4-ccae-4594-afb0-93da88c62e1d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:17.101800 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b02578d4-ccae-4594-afb0-93da88c62e1d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:17.124384 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-b02578d4-ccae-4594-afb0-93da88c62e1d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5/ips" status: 200 len: 148 microversion: 2.1 time: 0.035927 Oct 18 11:44:17.124959 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 265/510] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Oct 18 11:44:17 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5/ips => generated 148 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:44:17.136615 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-814e59f5-c5bf-4086-af73-1bf1ba577d05 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0199a44-ae26-486c-8aca-e1c4de2117d6"}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:44:17.139035 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-814e59f5-c5bf-4086-af73-1bf1ba577d05 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:17.146482 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-814e59f5-c5bf-4086-af73-1bf1ba577d05 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:17.146957 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-814e59f5-c5bf-4086-af73-1bf1ba577d05 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:17.147892 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-814e59f5-c5bf-4086-af73-1bf1ba577d05 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:17.148566 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-814e59f5-c5bf-4086-af73-1bf1ba577d05 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:17.149069 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-814e59f5-c5bf-4086-af73-1bf1ba577d05 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:17.149543 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-814e59f5-c5bf-4086-af73-1bf1ba577d05 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:17.228434 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.wsgi [None req-814e59f5-c5bf-4086-af73-1bf1ba577d05 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] HTTP exception thrown: Invalid volume: volume d0199a44-ae26-486c-8aca-e1c4de2117d6 is already attached to instances: b3ed125b-4ca6-484d-9da6-d6e46fba2a13 Oct 18 11:44:17.230409 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-814e59f5-c5bf-4086-af73-1bf1ba577d05 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Request method failure captured: Oct 18 11:44:17.230409 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: request: POST /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5/os-volume_attachments HTTP/1.1 Oct 18 11:44:17.230409 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept: application/json Oct 18 11:44:17.230409 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept-Encoding: identity Oct 18 11:44:17.230409 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Connection: close Oct 18 11:44:17.230409 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Length: 74 Oct 18 11:44:17.230409 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Type: application/json Oct 18 11:44:17.230409 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Host: 10.222.0.17 Oct 18 11:44:17.230409 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Openstack-System-Scope: None Oct 18 11:44:17.230409 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: User-Agent: python-urllib3/1.26.12 Oct 18 11:44:17.230409 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Auth-Token: gAAAAABjTpC0QX2SvHowI5-vz58GDwpVMERgGiI-pqt2GQ4o1fdQFbeIrfuLVtcw55IWYTDh91fNo1KVKFcag_YfGjslSHmWVAe8eH9iiMTcKmdOtt4MUEPPWZ9OQcF5wlXB0WJP-XHDUtk0mAsVICaitUhEDH7cqfrNMho4FbOB0yKZgk6M4Ns Oct 18 11:44:17.230409 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Id: None Oct 18 11:44:17.230409 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Name: None Oct 18 11:44:17.230409 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Identity-Status: Confirmed Oct 18 11:44:17.230409 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Is-Admin-Project: True Oct 18 11:44:17.230409 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Id: default Oct 18 11:44:17.230409 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Name: Default Oct 18 11:44:17.230409 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Id: 633afaabbbff47a4a99ebc997e67b01a Oct 18 11:44:17.230409 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Name: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:44:17.230409 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Role: reader,member Oct 18 11:44:17.230409 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Roles: reader,member Oct 18 11:44:17.231952 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/633afaabbbff47a4a99ebc997e67b01a"}]}] Oct 18 11:44:17.231952 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:44:17.231952 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Id: 633afaabbbff47a4a99ebc997e67b01a Oct 18 11:44:17.231952 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:44:17.231952 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User: tempest-AttachVolumeNegativeTest-1091652349-project Oct 18 11:44:17.231952 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Id: default Oct 18 11:44:17.231952 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Name: Default Oct 18 11:44:17.231952 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Id: 916699a212eb4d8aa945f299ac0d4c96 Oct 18 11:44:17.231952 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Name: tempest-AttachVolumeNegativeTest-1091652349-project Oct 18 11:44:17.231952 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Oct 18 11:44:17.231952 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: {"volumeAttachment": {"volumeId": "d0199a44-ae26-486c-8aca-e1c4de2117d6"}} Oct 18 11:44:17.231952 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: method: > Oct 18 11:44:17.232795 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: exception: Invalid volume: volume d0199a44-ae26-486c-8aca-e1c4de2117d6 is already attached to instances: b3ed125b-4ca6-484d-9da6-d6e46fba2a13 Oct 18 11:44:17.232795 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: action_args: {'server_id': '5ea63cc8-527d-46ea-b6ef-d778dadb8ec5', 'body': {'volumeAttachment': {'volumeId': 'd0199a44-ae26-486c-8aca-e1c4de2117d6'}}} Oct 18 11:44:17.232795 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:44:17.232795 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:44:17.232795 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 18 11:44:17.232795 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 18 11:44:17.232795 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 11:44:17.232795 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 11:44:17.232795 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 18 11:44:17.232795 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 11:44:17.232795 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 18 11:44:17.232795 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 18 11:44:17.232795 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 18 11:44:17.232795 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 18 11:44:17.232795 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d0199a44-ae26-486c-8aca-e1c4de2117d6 is already attached to instances: b3ed125b-4ca6-484d-9da6-d6e46fba2a13 Oct 18 11:44:17.232795 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:44:17.232795 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:44:17.232795 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:44:17.232795 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:44:17.234008 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:44:17.234008 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:44:17.234008 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:44:17.234008 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:44:17.234008 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:44:17.234008 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:44:17.234008 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 11:44:17.234008 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 11:44:17.234008 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 11:44:17.234008 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 11:44:17.234008 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 11:44:17.234008 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 11:44:17.234008 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 18 11:44:17.234008 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 18 11:44:17.234008 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d0199a44-ae26-486c-8aca-e1c4de2117d6 is already attached to instances: b3ed125b-4ca6-484d-9da6-d6e46fba2a13 Oct 18 11:44:17.234008 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:44:17.234008 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:44:17.234008 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:44:17.234008 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:44:17.234008 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:44:17.235263 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:44:17.235263 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:44:17.235263 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:44:17.235263 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d0199a44-ae26-486c-8aca-e1c4de2117d6 is already attached to instances: b3ed125b-4ca6-484d-9da6-d6e46fba2a13 Oct 18 11:44:17.235263 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:44:17.235263 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-814e59f5-c5bf-4086-af73-1bf1ba577d05 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Returning 400 to user: Invalid volume: volume d0199a44-ae26-486c-8aca-e1c4de2117d6 is already attached to instances: b3ed125b-4ca6-484d-9da6-d6e46fba2a13 {{(pid=125486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:44:17.235263 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-814e59f5-c5bf-4086-af73-1bf1ba577d05 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "POST /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099315 Oct 18 11:44:17.235263 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 246/511] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Oct 18 11:44:17 2022] POST /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 18 11:44:17.240978 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-98012fe1-7213-4369-8ed3-4224cca93e1d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:17.241482 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-98012fe1-7213-4369-8ed3-4224cca93e1d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:17.247355 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-98012fe1-7213-4369-8ed3-4224cca93e1d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:17.247831 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-98012fe1-7213-4369-8ed3-4224cca93e1d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:17.248260 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-98012fe1-7213-4369-8ed3-4224cca93e1d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:17.248967 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-98012fe1-7213-4369-8ed3-4224cca93e1d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:17.249419 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-98012fe1-7213-4369-8ed3-4224cca93e1d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:17.249836 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-98012fe1-7213-4369-8ed3-4224cca93e1d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:17.277107 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-98012fe1-7213-4369-8ed3-4224cca93e1d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Going to try to terminate instance {{(pid=125485) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 11:44:17.351214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-98012fe1-7213-4369-8ed3-4224cca93e1d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 204 len: 0 microversion: 2.1 time: 0.113660 Oct 18 11:44:17.351726 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 266/512] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Oct 18 11:44:17 2022] DELETE /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 11:44:17.361418 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-89c4c58c-c5ac-4876-96fd-23848e500568 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:17.362049 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-89c4c58c-c5ac-4876-96fd-23848e500568 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:17.368628 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-89c4c58c-c5ac-4876-96fd-23848e500568 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:17.369142 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-89c4c58c-c5ac-4876-96fd-23848e500568 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:17.369574 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-89c4c58c-c5ac-4876-96fd-23848e500568 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:17.370538 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-89c4c58c-c5ac-4876-96fd-23848e500568 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:17.370992 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-89c4c58c-c5ac-4876-96fd-23848e500568 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:17.371440 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-89c4c58c-c5ac-4876-96fd-23848e500568 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:17.498822 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-89c4c58c-c5ac-4876-96fd-23848e500568 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:17.506444 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-89c4c58c-c5ac-4876-96fd-23848e500568 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1680 microversion: 2.1 time: 0.149408 Oct 18 11:44:17.507505 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 247/513] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:17 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:44:17.563447 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-00244e19-773b-419f-9361-7a4f9e8f1cbd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:17.564143 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-00244e19-773b-419f-9361-7a4f9e8f1cbd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:17.571235 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-00244e19-773b-419f-9361-7a4f9e8f1cbd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:17.571716 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-00244e19-773b-419f-9361-7a4f9e8f1cbd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:17.572148 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-00244e19-773b-419f-9361-7a4f9e8f1cbd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:17.572835 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-00244e19-773b-419f-9361-7a4f9e8f1cbd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:17.573312 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-00244e19-773b-419f-9361-7a4f9e8f1cbd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:17.573727 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-00244e19-773b-419f-9361-7a4f9e8f1cbd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:17.701967 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-00244e19-773b-419f-9361-7a4f9e8f1cbd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:17.710427 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-00244e19-773b-419f-9361-7a4f9e8f1cbd tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1735 microversion: 2.1 time: 0.151245 Oct 18 11:44:17.711096 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 267/514] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:17 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:17.868757 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-a92a6e2e-8aa5-437d-bcee-d890189e2d62 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:17.869404 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-a92a6e2e-8aa5-437d-bcee-d890189e2d62 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:17.875578 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a92a6e2e-8aa5-437d-bcee-d890189e2d62 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:17.876056 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a92a6e2e-8aa5-437d-bcee-d890189e2d62 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:17.876479 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a92a6e2e-8aa5-437d-bcee-d890189e2d62 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:17.877189 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a92a6e2e-8aa5-437d-bcee-d890189e2d62 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:17.877645 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a92a6e2e-8aa5-437d-bcee-d890189e2d62 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:17.878041 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a92a6e2e-8aa5-437d-bcee-d890189e2d62 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:18.021498 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-a92a6e2e-8aa5-437d-bcee-d890189e2d62 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:18.030229 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-a92a6e2e-8aa5-437d-bcee-d890189e2d62 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1756 microversion: 2.1 time: 0.165348 Oct 18 11:44:18.030790 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 248/515] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:17 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:18.530167 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-6a5df248-3412-43b4-b0aa-0025a747fac5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:18.530799 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-6a5df248-3412-43b4-b0aa-0025a747fac5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:18.536890 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6a5df248-3412-43b4-b0aa-0025a747fac5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:18.537374 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6a5df248-3412-43b4-b0aa-0025a747fac5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:18.537804 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6a5df248-3412-43b4-b0aa-0025a747fac5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:18.538485 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6a5df248-3412-43b4-b0aa-0025a747fac5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:18.538931 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6a5df248-3412-43b4-b0aa-0025a747fac5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:18.539349 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6a5df248-3412-43b4-b0aa-0025a747fac5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:18.667817 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-6a5df248-3412-43b4-b0aa-0025a747fac5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:18.675713 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-6a5df248-3412-43b4-b0aa-0025a747fac5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1680 microversion: 2.1 time: 0.149327 Oct 18 11:44:18.676282 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 268/516] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:18 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:18.733454 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-6c6b4abb-49a5-4799-a59e-9f77053d0d36 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:18.734101 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-6c6b4abb-49a5-4799-a59e-9f77053d0d36 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:18.740531 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6c6b4abb-49a5-4799-a59e-9f77053d0d36 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:18.741652 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6c6b4abb-49a5-4799-a59e-9f77053d0d36 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:18.742080 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6c6b4abb-49a5-4799-a59e-9f77053d0d36 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:18.742752 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6c6b4abb-49a5-4799-a59e-9f77053d0d36 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:18.743198 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6c6b4abb-49a5-4799-a59e-9f77053d0d36 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:18.743611 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6c6b4abb-49a5-4799-a59e-9f77053d0d36 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:18.878308 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-6c6b4abb-49a5-4799-a59e-9f77053d0d36 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:18.886608 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-6c6b4abb-49a5-4799-a59e-9f77053d0d36 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1735 microversion: 2.1 time: 0.157082 Oct 18 11:44:18.887173 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 249/517] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:18 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:19.053313 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-45bcaeea-551c-434f-9732-818c996ff9d6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:19.054496 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-45bcaeea-551c-434f-9732-818c996ff9d6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:19.060382 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-45bcaeea-551c-434f-9732-818c996ff9d6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:19.060875 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-45bcaeea-551c-434f-9732-818c996ff9d6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:19.061314 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-45bcaeea-551c-434f-9732-818c996ff9d6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:19.061994 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-45bcaeea-551c-434f-9732-818c996ff9d6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:19.062445 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-45bcaeea-551c-434f-9732-818c996ff9d6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:19.062860 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-45bcaeea-551c-434f-9732-818c996ff9d6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:19.221342 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-45bcaeea-551c-434f-9732-818c996ff9d6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:19.230376 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-45bcaeea-551c-434f-9732-818c996ff9d6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1756 microversion: 2.1 time: 0.180844 Oct 18 11:44:19.230962 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 269/518] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:19 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:19.700876 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-d3649255-67fc-484a-b930-28dc85c68f0b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:19.701395 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-d3649255-67fc-484a-b930-28dc85c68f0b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:19.707608 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d3649255-67fc-484a-b930-28dc85c68f0b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:19.708096 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d3649255-67fc-484a-b930-28dc85c68f0b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:19.708522 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d3649255-67fc-484a-b930-28dc85c68f0b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:19.709508 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d3649255-67fc-484a-b930-28dc85c68f0b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:19.710568 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d3649255-67fc-484a-b930-28dc85c68f0b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:19.710983 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d3649255-67fc-484a-b930-28dc85c68f0b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:19.906623 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-d3649255-67fc-484a-b930-28dc85c68f0b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:19.909393 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ce83cf10-c7a7-4425-b33b-4604b7777a2d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:19.910169 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-ce83cf10-c7a7-4425-b33b-4604b7777a2d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:19.914838 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-d3649255-67fc-484a-b930-28dc85c68f0b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1680 microversion: 2.1 time: 0.217745 Oct 18 11:44:19.915819 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 250/519] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:19 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1680 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:19.917329 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ce83cf10-c7a7-4425-b33b-4604b7777a2d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:19.917817 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ce83cf10-c7a7-4425-b33b-4604b7777a2d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:19.918248 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ce83cf10-c7a7-4425-b33b-4604b7777a2d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:19.918943 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ce83cf10-c7a7-4425-b33b-4604b7777a2d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:19.919389 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ce83cf10-c7a7-4425-b33b-4604b7777a2d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:19.919805 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ce83cf10-c7a7-4425-b33b-4604b7777a2d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:20.063951 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-ce83cf10-c7a7-4425-b33b-4604b7777a2d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:20.074044 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-ce83cf10-c7a7-4425-b33b-4604b7777a2d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1735 microversion: 2.1 time: 0.168829 Oct 18 11:44:20.074648 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 270/520] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:19 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:20.255695 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-fd2f706c-f4ee-4c0d-9623-204751580947 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:20.256392 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-fd2f706c-f4ee-4c0d-9623-204751580947 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:20.262658 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fd2f706c-f4ee-4c0d-9623-204751580947 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:20.263234 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fd2f706c-f4ee-4c0d-9623-204751580947 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:20.263892 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fd2f706c-f4ee-4c0d-9623-204751580947 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:20.264832 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fd2f706c-f4ee-4c0d-9623-204751580947 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:20.265462 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fd2f706c-f4ee-4c0d-9623-204751580947 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:20.265888 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fd2f706c-f4ee-4c0d-9623-204751580947 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:20.289890 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-6bd4350e-16fc-48d9-8ff9-fafceefb5904 req-e3c96ca8-95f6-40d5-9539-68f13ed0fcfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ea63cc8-527d-46ea-b6ef-d778dadb8ec5", "name": "network-vif-deleted", "tag": "c6da8082-87ec-4172-bf6f-d60ef1511c4e"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:44:20.299974 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-6bd4350e-16fc-48d9-8ff9-fafceefb5904 req-e3c96ca8-95f6-40d5-9539-68f13ed0fcfb service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:20.300350 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-6bd4350e-16fc-48d9-8ff9-fafceefb5904 req-e3c96ca8-95f6-40d5-9539-68f13ed0fcfb service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:20.300985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-6bd4350e-16fc-48d9-8ff9-fafceefb5904 req-e3c96ca8-95f6-40d5-9539-68f13ed0fcfb service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:20.329301 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-6bd4350e-16fc-48d9-8ff9-fafceefb5904 req-e3c96ca8-95f6-40d5-9539-68f13ed0fcfb service nova] Creating event network-vif-deleted:c6da8082-87ec-4172-bf6f-d60ef1511c4e for instance 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 on hv-cinder-81558 Oct 18 11:44:20.335658 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-6bd4350e-16fc-48d9-8ff9-fafceefb5904 req-e3c96ca8-95f6-40d5-9539-68f13ed0fcfb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049166 Oct 18 11:44:20.336557 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 271/521] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:44:20.433384 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-fd2f706c-f4ee-4c0d-9623-204751580947 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:20.441955 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-fd2f706c-f4ee-4c0d-9623-204751580947 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1756 microversion: 2.1 time: 0.190654 Oct 18 11:44:20.457897 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 251/522] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:20 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:20.940597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-84ad2e0e-bd24-4bdb-8398-bdcb2f4d4c0c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:20.941548 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-84ad2e0e-bd24-4bdb-8398-bdcb2f4d4c0c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:20.948236 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-84ad2e0e-bd24-4bdb-8398-bdcb2f4d4c0c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:20.948719 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-84ad2e0e-bd24-4bdb-8398-bdcb2f4d4c0c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:20.949186 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-84ad2e0e-bd24-4bdb-8398-bdcb2f4d4c0c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:20.949980 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-84ad2e0e-bd24-4bdb-8398-bdcb2f4d4c0c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:20.950334 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-84ad2e0e-bd24-4bdb-8398-bdcb2f4d4c0c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:20.950755 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-84ad2e0e-bd24-4bdb-8398-bdcb2f4d4c0c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:20.983584 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-84ad2e0e-bd24-4bdb-8398-bdcb2f4d4c0c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:20.984084 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-84ad2e0e-bd24-4bdb-8398-bdcb2f4d4c0c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:20.984511 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-84ad2e0e-bd24-4bdb-8398-bdcb2f4d4c0c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:20.985007 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.objects.instance [None req-84ad2e0e-bd24-4bdb-8398-bdcb2f4d4c0c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lazy-loading 'fault' on Instance uuid 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 {{(pid=125485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:44:21.031593 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-84ad2e0e-bd24-4bdb-8398-bdcb2f4d4c0c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:21.039615 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-84ad2e0e-bd24-4bdb-8398-bdcb2f4d4c0c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 200 len: 1331 microversion: 2.1 time: 0.103666 Oct 18 11:44:21.040380 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 272/523] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:20 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:21.098020 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-c8b178e1-9b3d-4cce-9904-12b97768d9ac tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:21.098718 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-c8b178e1-9b3d-4cce-9904-12b97768d9ac tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:21.106876 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c8b178e1-9b3d-4cce-9904-12b97768d9ac tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:21.107447 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c8b178e1-9b3d-4cce-9904-12b97768d9ac tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:21.107946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c8b178e1-9b3d-4cce-9904-12b97768d9ac tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:21.108745 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c8b178e1-9b3d-4cce-9904-12b97768d9ac tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:21.109435 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c8b178e1-9b3d-4cce-9904-12b97768d9ac tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:21.109968 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c8b178e1-9b3d-4cce-9904-12b97768d9ac tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:21.257963 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-c8b178e1-9b3d-4cce-9904-12b97768d9ac tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:21.266504 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-c8b178e1-9b3d-4cce-9904-12b97768d9ac tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1735 microversion: 2.1 time: 0.172318 Oct 18 11:44:21.267056 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 252/524] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:21 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:21.465960 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-237290f2-2e3a-4395-b882-522fe48b5cf4 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:21.466557 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-237290f2-2e3a-4395-b882-522fe48b5cf4 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:21.472963 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-237290f2-2e3a-4395-b882-522fe48b5cf4 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:21.473446 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-237290f2-2e3a-4395-b882-522fe48b5cf4 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:21.473874 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-237290f2-2e3a-4395-b882-522fe48b5cf4 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:21.474619 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-237290f2-2e3a-4395-b882-522fe48b5cf4 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:21.475121 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-237290f2-2e3a-4395-b882-522fe48b5cf4 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:21.475571 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-237290f2-2e3a-4395-b882-522fe48b5cf4 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:21.622461 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-237290f2-2e3a-4395-b882-522fe48b5cf4 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:21.630648 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-237290f2-2e3a-4395-b882-522fe48b5cf4 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1756 microversion: 2.1 time: 0.168599 Oct 18 11:44:21.631214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 273/525] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:21 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:44:22.063166 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-196076c2-7f53-461f-b0e3-99d7cb48f5c9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:22.063693 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-196076c2-7f53-461f-b0e3-99d7cb48f5c9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:22.069655 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-196076c2-7f53-461f-b0e3-99d7cb48f5c9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:22.070207 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-196076c2-7f53-461f-b0e3-99d7cb48f5c9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:22.070577 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-196076c2-7f53-461f-b0e3-99d7cb48f5c9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:22.071268 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-196076c2-7f53-461f-b0e3-99d7cb48f5c9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:22.071720 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-196076c2-7f53-461f-b0e3-99d7cb48f5c9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:22.072144 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-196076c2-7f53-461f-b0e3-99d7cb48f5c9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:22.085980 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.wsgi [None req-196076c2-7f53-461f-b0e3-99d7cb48f5c9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] HTTP exception thrown: Instance 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 could not be found. Oct 18 11:44:22.087425 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-196076c2-7f53-461f-b0e3-99d7cb48f5c9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Request method failure captured: Oct 18 11:44:22.087425 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: request: GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 HTTP/1.1 Oct 18 11:44:22.087425 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept: application/json Oct 18 11:44:22.087425 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept-Encoding: identity Oct 18 11:44:22.087425 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Connection: close Oct 18 11:44:22.087425 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Length: 0 Oct 18 11:44:22.087425 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Type: application/json Oct 18 11:44:22.087425 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Host: 10.222.0.17 Oct 18 11:44:22.087425 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Openstack-System-Scope: None Oct 18 11:44:22.087425 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: User-Agent: python-urllib3/1.26.12 Oct 18 11:44:22.087425 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Auth-Token: gAAAAABjTpC0QX2SvHowI5-vz58GDwpVMERgGiI-pqt2GQ4o1fdQFbeIrfuLVtcw55IWYTDh91fNo1KVKFcag_YfGjslSHmWVAe8eH9iiMTcKmdOtt4MUEPPWZ9OQcF5wlXB0WJP-XHDUtk0mAsVICaitUhEDH7cqfrNMho4FbOB0yKZgk6M4Ns Oct 18 11:44:22.087425 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Id: None Oct 18 11:44:22.087425 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Name: None Oct 18 11:44:22.087425 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Identity-Status: Confirmed Oct 18 11:44:22.087425 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Is-Admin-Project: True Oct 18 11:44:22.087425 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Id: default Oct 18 11:44:22.087425 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Name: Default Oct 18 11:44:22.087425 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Id: 633afaabbbff47a4a99ebc997e67b01a Oct 18 11:44:22.087425 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Name: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:44:22.087425 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Role: reader,member Oct 18 11:44:22.087425 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Roles: reader,member Oct 18 11:44:22.089030 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/633afaabbbff47a4a99ebc997e67b01a"}]}] Oct 18 11:44:22.089030 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:44:22.089030 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Id: 633afaabbbff47a4a99ebc997e67b01a Oct 18 11:44:22.089030 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:44:22.089030 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User: tempest-AttachVolumeNegativeTest-1091652349-project Oct 18 11:44:22.089030 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Id: default Oct 18 11:44:22.089030 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Name: Default Oct 18 11:44:22.089030 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Id: 916699a212eb4d8aa945f299ac0d4c96 Oct 18 11:44:22.089030 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Name: tempest-AttachVolumeNegativeTest-1091652349-project Oct 18 11:44:22.089030 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: method: > Oct 18 11:44:22.089030 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: exception: Instance 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 could not be found. Oct 18 11:44:22.089030 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: action_args: {'id': '5ea63cc8-527d-46ea-b6ef-d778dadb8ec5'} Oct 18 11:44:22.089842 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:44:22.089842 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:44:22.089842 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:44:22.089842 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:44:22.089842 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:44:22.089842 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:44:22.089842 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:44:22.089842 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:44:22.089842 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:44:22.089842 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:44:22.089842 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 could not be found. Oct 18 11:44:22.089842 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:44:22.089842 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:44:22.089842 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:44:22.089842 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:44:22.089842 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:44:22.089842 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:44:22.089842 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:44:22.089842 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:44:22.089842 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:44:22.091062 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:44:22.091062 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 11:44:22.091062 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 11:44:22.091062 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:44:22.091062 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:44:22.091062 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:44:22.091062 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:44:22.091062 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 could not be found. Oct 18 11:44:22.091062 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:44:22.091062 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:44:22.091062 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:44:22.091062 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:44:22.091062 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:44:22.091062 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:44:22.091062 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:44:22.091062 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:44:22.091062 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 could not be found. Oct 18 11:44:22.091062 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:44:22.092352 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-196076c2-7f53-461f-b0e3-99d7cb48f5c9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Returning 404 to user: Instance 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 could not be found. {{(pid=125486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:44:22.092352 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-196076c2-7f53-461f-b0e3-99d7cb48f5c9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 404 len: 111 microversion: 2.1 time: 0.029659 Oct 18 11:44:22.092352 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 253/526] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:22 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:44:22.097585 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-3c20325a-3d3e-4b23-a2d6-9f9ca3e43080 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '.version_select at 0x7f4be0d380d0>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:22.117862 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-3c20325a-3d3e-4b23-a2d6-9f9ca3e43080 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1625554540" status: 202 len: 0 microversion: 2.1 time: 0.023979 Oct 18 11:44:22.121974 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 274/527] 10.222.0.17 () {58 vars in 1221 bytes} [Tue Oct 18 11:44:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1625554540 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 11:44:22.291277 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-da28e6ef-ca9c-4ed3-b39f-656ad0897286 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:22.293015 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-da28e6ef-ca9c-4ed3-b39f-656ad0897286 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:22.300715 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-da28e6ef-ca9c-4ed3-b39f-656ad0897286 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:22.301297 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-da28e6ef-ca9c-4ed3-b39f-656ad0897286 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:22.301737 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-da28e6ef-ca9c-4ed3-b39f-656ad0897286 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:22.302450 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-da28e6ef-ca9c-4ed3-b39f-656ad0897286 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:22.302899 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-da28e6ef-ca9c-4ed3-b39f-656ad0897286 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:22.306834 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-da28e6ef-ca9c-4ed3-b39f-656ad0897286 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:22.460806 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-da28e6ef-ca9c-4ed3-b39f-656ad0897286 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:22.470245 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-da28e6ef-ca9c-4ed3-b39f-656ad0897286 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1735 microversion: 2.1 time: 0.184284 Oct 18 11:44:22.472234 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 254/528] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:22 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:22.655218 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-5757f25e-14cf-489f-a77f-f8aab0fdd5c7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:22.656178 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-5757f25e-14cf-489f-a77f-f8aab0fdd5c7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:22.663496 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5757f25e-14cf-489f-a77f-f8aab0fdd5c7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:22.664267 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5757f25e-14cf-489f-a77f-f8aab0fdd5c7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:22.665701 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5757f25e-14cf-489f-a77f-f8aab0fdd5c7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:22.666669 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5757f25e-14cf-489f-a77f-f8aab0fdd5c7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:22.667532 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5757f25e-14cf-489f-a77f-f8aab0fdd5c7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:22.668161 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5757f25e-14cf-489f-a77f-f8aab0fdd5c7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:22.875581 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-5757f25e-14cf-489f-a77f-f8aab0fdd5c7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:22.884558 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-5757f25e-14cf-489f-a77f-f8aab0fdd5c7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1756 microversion: 2.1 time: 0.233514 Oct 18 11:44:22.885155 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 275/529] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:22 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1756 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:22.886122 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-1a16e937-5e77-401f-8d73-fdceffda3b63 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:22.886651 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-1a16e937-5e77-401f-8d73-fdceffda3b63 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:22.892687 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1a16e937-5e77-401f-8d73-fdceffda3b63 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:22.893208 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1a16e937-5e77-401f-8d73-fdceffda3b63 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:22.893645 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1a16e937-5e77-401f-8d73-fdceffda3b63 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:22.894339 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1a16e937-5e77-401f-8d73-fdceffda3b63 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:22.894792 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1a16e937-5e77-401f-8d73-fdceffda3b63 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:22.895216 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1a16e937-5e77-401f-8d73-fdceffda3b63 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:23.017830 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.objects.instance [None req-1a16e937-5e77-401f-8d73-fdceffda3b63 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lazy-loading 'services' on Instance uuid b3ed125b-4ca6-484d-9da6-d6e46fba2a13 {{(pid=125486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:44:23.130763 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-1a16e937-5e77-401f-8d73-fdceffda3b63 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13/os-volume_attachments/d0199a44-ae26-486c-8aca-e1c4de2117d6" status: 202 len: 0 microversion: 2.1 time: 0.248926 Oct 18 11:44:23.131355 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 255/530] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Oct 18 11:44:22 2022] DELETE /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13/os-volume_attachments/d0199a44-ae26-486c-8aca-e1c4de2117d6 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 11:44:23.141810 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-adc9fcfc-76cd-45c6-837a-62ca9a651c5b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:23.144135 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-adc9fcfc-76cd-45c6-837a-62ca9a651c5b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:23.151198 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-adc9fcfc-76cd-45c6-837a-62ca9a651c5b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:23.151765 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-adc9fcfc-76cd-45c6-837a-62ca9a651c5b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:23.152283 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-adc9fcfc-76cd-45c6-837a-62ca9a651c5b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:23.153257 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-adc9fcfc-76cd-45c6-837a-62ca9a651c5b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:23.153671 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-adc9fcfc-76cd-45c6-837a-62ca9a651c5b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:23.154083 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-adc9fcfc-76cd-45c6-837a-62ca9a651c5b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:23.200747 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-adc9fcfc-76cd-45c6-837a-62ca9a651c5b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064219 Oct 18 11:44:23.201359 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 276/531] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Oct 18 11:44:23 2022] GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:44:23.496185 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-976cc93c-e56c-4901-8b72-e1a4684a0f45 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:23.496800 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-976cc93c-e56c-4901-8b72-e1a4684a0f45 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:23.503659 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-976cc93c-e56c-4901-8b72-e1a4684a0f45 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:23.504140 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-976cc93c-e56c-4901-8b72-e1a4684a0f45 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:23.504580 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-976cc93c-e56c-4901-8b72-e1a4684a0f45 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:23.505301 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-976cc93c-e56c-4901-8b72-e1a4684a0f45 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:23.505752 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-976cc93c-e56c-4901-8b72-e1a4684a0f45 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:23.506174 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-976cc93c-e56c-4901-8b72-e1a4684a0f45 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:23.635333 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-976cc93c-e56c-4901-8b72-e1a4684a0f45 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:23.643414 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-976cc93c-e56c-4901-8b72-e1a4684a0f45 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1735 microversion: 2.1 time: 0.152051 Oct 18 11:44:23.643970 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 256/532] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:23 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:23.907515 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-55527557-4b97-4ba3-9db2-8db758e01de9 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:23.908160 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-55527557-4b97-4ba3-9db2-8db758e01de9 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:23.914356 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-55527557-4b97-4ba3-9db2-8db758e01de9 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:23.914954 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-55527557-4b97-4ba3-9db2-8db758e01de9 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:23.915443 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-55527557-4b97-4ba3-9db2-8db758e01de9 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:23.916268 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-55527557-4b97-4ba3-9db2-8db758e01de9 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:23.916833 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-55527557-4b97-4ba3-9db2-8db758e01de9 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:23.917278 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-55527557-4b97-4ba3-9db2-8db758e01de9 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:23.921401 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:44:24.065627 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-55527557-4b97-4ba3-9db2-8db758e01de9 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:24.074182 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-55527557-4b97-4ba3-9db2-8db758e01de9 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1756 microversion: 2.1 time: 0.170449 Oct 18 11:44:24.074755 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 277/533] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:23 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:24.213815 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-ff33979b-4ceb-4108-b903-4004af1b5e53 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:24.216071 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-ff33979b-4ceb-4108-b903-4004af1b5e53 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:24.221978 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ff33979b-4ceb-4108-b903-4004af1b5e53 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:24.222455 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ff33979b-4ceb-4108-b903-4004af1b5e53 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:24.222881 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ff33979b-4ceb-4108-b903-4004af1b5e53 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:24.223558 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ff33979b-4ceb-4108-b903-4004af1b5e53 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:24.224008 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ff33979b-4ceb-4108-b903-4004af1b5e53 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:24.224421 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ff33979b-4ceb-4108-b903-4004af1b5e53 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:24.253965 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-ff33979b-4ceb-4108-b903-4004af1b5e53 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044138 Oct 18 11:44:24.254509 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 257/534] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Oct 18 11:44:24 2022] GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 11:44:24.317607 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-fb8b3961-f4ce-4d17-b6e2-ffd4ba541514 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:24.318319 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-fb8b3961-f4ce-4d17-b6e2-ffd4ba541514 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:24.324750 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fb8b3961-f4ce-4d17-b6e2-ffd4ba541514 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:24.325262 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fb8b3961-f4ce-4d17-b6e2-ffd4ba541514 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:24.325687 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fb8b3961-f4ce-4d17-b6e2-ffd4ba541514 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:24.326361 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fb8b3961-f4ce-4d17-b6e2-ffd4ba541514 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:24.326801 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fb8b3961-f4ce-4d17-b6e2-ffd4ba541514 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:24.327214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fb8b3961-f4ce-4d17-b6e2-ffd4ba541514 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:24.353126 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-fb8b3961-f4ce-4d17-b6e2-ffd4ba541514 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Going to try to terminate instance {{(pid=125485) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 11:44:24.424227 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-fb8b3961-f4ce-4d17-b6e2-ffd4ba541514 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13" status: 204 len: 0 microversion: 2.1 time: 0.110192 Oct 18 11:44:24.424798 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 278/535] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Oct 18 11:44:24 2022] DELETE /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 11:44:24.434074 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-8d376380-76c1-4aa9-becc-823b6bdb0df2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:24.434683 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-8d376380-76c1-4aa9-becc-823b6bdb0df2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:24.440586 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8d376380-76c1-4aa9-becc-823b6bdb0df2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:24.441096 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8d376380-76c1-4aa9-becc-823b6bdb0df2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:24.441534 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8d376380-76c1-4aa9-becc-823b6bdb0df2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:24.442216 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8d376380-76c1-4aa9-becc-823b6bdb0df2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:24.442657 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8d376380-76c1-4aa9-becc-823b6bdb0df2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:24.443074 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8d376380-76c1-4aa9-becc-823b6bdb0df2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:24.447698 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:44:24.580301 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-8d376380-76c1-4aa9-becc-823b6bdb0df2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:24.588489 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-8d376380-76c1-4aa9-becc-823b6bdb0df2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13" status: 200 len: 1679 microversion: 2.1 time: 0.158632 Oct 18 11:44:24.589087 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 258/536] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:24 2022] GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:24.666192 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-4290920f-77dd-4b95-9378-6557cda6bb1f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:24.666877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-4290920f-77dd-4b95-9378-6557cda6bb1f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:24.672748 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4290920f-77dd-4b95-9378-6557cda6bb1f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:24.673256 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4290920f-77dd-4b95-9378-6557cda6bb1f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:24.673681 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4290920f-77dd-4b95-9378-6557cda6bb1f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:24.674349 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4290920f-77dd-4b95-9378-6557cda6bb1f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:24.674811 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4290920f-77dd-4b95-9378-6557cda6bb1f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:24.675220 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4290920f-77dd-4b95-9378-6557cda6bb1f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:24.808647 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-4290920f-77dd-4b95-9378-6557cda6bb1f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:24.816747 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-4290920f-77dd-4b95-9378-6557cda6bb1f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1735 microversion: 2.1 time: 0.154839 Oct 18 11:44:24.817335 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 279/537] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:24 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:25.097623 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-1e837fbe-8423-44fd-8f07-a4a9e8f03f3b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:25.098233 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-1e837fbe-8423-44fd-8f07-a4a9e8f03f3b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:25.104772 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1e837fbe-8423-44fd-8f07-a4a9e8f03f3b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:25.105291 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1e837fbe-8423-44fd-8f07-a4a9e8f03f3b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:25.105719 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1e837fbe-8423-44fd-8f07-a4a9e8f03f3b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:25.106398 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1e837fbe-8423-44fd-8f07-a4a9e8f03f3b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:25.106845 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1e837fbe-8423-44fd-8f07-a4a9e8f03f3b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:25.107263 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1e837fbe-8423-44fd-8f07-a4a9e8f03f3b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:25.250175 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-1e837fbe-8423-44fd-8f07-a4a9e8f03f3b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:25.259027 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-1e837fbe-8423-44fd-8f07-a4a9e8f03f3b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1756 microversion: 2.1 time: 0.165251 Oct 18 11:44:25.259592 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 259/538] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:25 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:25.611328 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-19bab910-2c4e-490c-b638-d48ed6fdee27 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:25.611933 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-19bab910-2c4e-490c-b638-d48ed6fdee27 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:25.618274 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-19bab910-2c4e-490c-b638-d48ed6fdee27 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:25.618745 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-19bab910-2c4e-490c-b638-d48ed6fdee27 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:25.619170 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-19bab910-2c4e-490c-b638-d48ed6fdee27 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:25.619840 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-19bab910-2c4e-490c-b638-d48ed6fdee27 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:25.620281 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-19bab910-2c4e-490c-b638-d48ed6fdee27 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:25.620694 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-19bab910-2c4e-490c-b638-d48ed6fdee27 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:25.751150 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-19bab910-2c4e-490c-b638-d48ed6fdee27 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:25.759465 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-19bab910-2c4e-490c-b638-d48ed6fdee27 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13" status: 200 len: 1679 microversion: 2.1 time: 0.151942 Oct 18 11:44:25.760025 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 280/539] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:25 2022] GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:25.840565 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-3919d7a8-cf61-4aac-938c-455deb0fbaa6 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:25.841205 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-3919d7a8-cf61-4aac-938c-455deb0fbaa6 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:25.847657 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3919d7a8-cf61-4aac-938c-455deb0fbaa6 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:25.848140 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3919d7a8-cf61-4aac-938c-455deb0fbaa6 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:25.848571 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3919d7a8-cf61-4aac-938c-455deb0fbaa6 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:25.849283 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3919d7a8-cf61-4aac-938c-455deb0fbaa6 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:25.849732 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3919d7a8-cf61-4aac-938c-455deb0fbaa6 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:25.850813 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3919d7a8-cf61-4aac-938c-455deb0fbaa6 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:25.981277 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-3919d7a8-cf61-4aac-938c-455deb0fbaa6 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:25.989465 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-3919d7a8-cf61-4aac-938c-455deb0fbaa6 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1735 microversion: 2.1 time: 0.152726 Oct 18 11:44:25.990036 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 260/540] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:25 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:26.282699 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-afedfa8b-5112-41d6-ba28-07738afb8abd tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:26.283307 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-afedfa8b-5112-41d6-ba28-07738afb8abd tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:26.289708 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-afedfa8b-5112-41d6-ba28-07738afb8abd tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:26.290179 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-afedfa8b-5112-41d6-ba28-07738afb8abd tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:26.290603 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-afedfa8b-5112-41d6-ba28-07738afb8abd tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:26.291273 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-afedfa8b-5112-41d6-ba28-07738afb8abd tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:26.291715 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-afedfa8b-5112-41d6-ba28-07738afb8abd tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:26.292128 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-afedfa8b-5112-41d6-ba28-07738afb8abd tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:26.436264 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-afedfa8b-5112-41d6-ba28-07738afb8abd tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:26.445662 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-afedfa8b-5112-41d6-ba28-07738afb8abd tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1756 microversion: 2.1 time: 0.167154 Oct 18 11:44:26.446794 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 281/541] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:26 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:26.783664 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-f1383f2b-db89-4b4c-a9b4-1e062cb09c14 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:26.784282 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-f1383f2b-db89-4b4c-a9b4-1e062cb09c14 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:26.791890 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f1383f2b-db89-4b4c-a9b4-1e062cb09c14 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:26.792378 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f1383f2b-db89-4b4c-a9b4-1e062cb09c14 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:26.792815 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f1383f2b-db89-4b4c-a9b4-1e062cb09c14 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:26.793552 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f1383f2b-db89-4b4c-a9b4-1e062cb09c14 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:26.794033 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f1383f2b-db89-4b4c-a9b4-1e062cb09c14 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:26.794462 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f1383f2b-db89-4b4c-a9b4-1e062cb09c14 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:26.879521 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-f1383f2b-db89-4b4c-a9b4-1e062cb09c14 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:26.887712 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-f1383f2b-db89-4b4c-a9b4-1e062cb09c14 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13" status: 200 len: 1612 microversion: 2.1 time: 0.108009 Oct 18 11:44:26.888309 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 261/542] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:26 2022] GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13 => generated 1612 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:27.014979 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-eb8a7af5-2dde-410c-9d05-852b75cae294 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:27.016193 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-eb8a7af5-2dde-410c-9d05-852b75cae294 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:27.027921 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-eb8a7af5-2dde-410c-9d05-852b75cae294 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:27.028930 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-eb8a7af5-2dde-410c-9d05-852b75cae294 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:27.029757 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-eb8a7af5-2dde-410c-9d05-852b75cae294 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:27.031122 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-eb8a7af5-2dde-410c-9d05-852b75cae294 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:27.032093 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-eb8a7af5-2dde-410c-9d05-852b75cae294 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:27.033057 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-eb8a7af5-2dde-410c-9d05-852b75cae294 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:27.097201 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-beb746b2-27f2-4532-a99b-c8a00f937de9 req-ff2775cd-5858-4eb3-a694-97882aa2b6fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3ed125b-4ca6-484d-9da6-d6e46fba2a13", "name": "network-vif-deleted", "tag": "d543b925-1dd1-417b-8252-8a6c6aa87525"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:44:27.108071 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-beb746b2-27f2-4532-a99b-c8a00f937de9 req-ff2775cd-5858-4eb3-a694-97882aa2b6fb service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:27.108669 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-beb746b2-27f2-4532-a99b-c8a00f937de9 req-ff2775cd-5858-4eb3-a694-97882aa2b6fb service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:27.109220 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-beb746b2-27f2-4532-a99b-c8a00f937de9 req-ff2775cd-5858-4eb3-a694-97882aa2b6fb service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:27.129043 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-beb746b2-27f2-4532-a99b-c8a00f937de9 req-ff2775cd-5858-4eb3-a694-97882aa2b6fb service nova] Creating event network-vif-deleted:d543b925-1dd1-417b-8252-8a6c6aa87525 for instance b3ed125b-4ca6-484d-9da6-d6e46fba2a13 on hv-cinder-81558 Oct 18 11:44:27.140317 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-beb746b2-27f2-4532-a99b-c8a00f937de9 req-ff2775cd-5858-4eb3-a694-97882aa2b6fb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046060 Oct 18 11:44:27.142140 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 262/543] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:44:27.305538 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-eb8a7af5-2dde-410c-9d05-852b75cae294 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:27.317050 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-eb8a7af5-2dde-410c-9d05-852b75cae294 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1735 microversion: 2.1 time: 0.308761 Oct 18 11:44:27.317933 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 282/544] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:27 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1735 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:27.470440 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-33ced9d6-7d0f-42a0-af68-c33e0f56eb02 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:27.471399 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-33ced9d6-7d0f-42a0-af68-c33e0f56eb02 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:27.479001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-33ced9d6-7d0f-42a0-af68-c33e0f56eb02 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:27.479798 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-33ced9d6-7d0f-42a0-af68-c33e0f56eb02 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:27.480227 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-33ced9d6-7d0f-42a0-af68-c33e0f56eb02 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:27.480971 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-33ced9d6-7d0f-42a0-af68-c33e0f56eb02 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:27.481416 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-33ced9d6-7d0f-42a0-af68-c33e0f56eb02 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:27.481833 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-33ced9d6-7d0f-42a0-af68-c33e0f56eb02 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:27.632067 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-33ced9d6-7d0f-42a0-af68-c33e0f56eb02 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:27.640751 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-33ced9d6-7d0f-42a0-af68-c33e0f56eb02 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1756 microversion: 2.1 time: 0.174437 Oct 18 11:44:27.641448 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 263/545] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:27 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:27.911761 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-372a6cb8-41f8-4d7c-9f42-b31aeaef13b9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:27.912923 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-372a6cb8-41f8-4d7c-9f42-b31aeaef13b9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:27.919158 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-372a6cb8-41f8-4d7c-9f42-b31aeaef13b9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:27.919644 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-372a6cb8-41f8-4d7c-9f42-b31aeaef13b9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:27.920090 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-372a6cb8-41f8-4d7c-9f42-b31aeaef13b9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:27.920967 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-372a6cb8-41f8-4d7c-9f42-b31aeaef13b9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:27.921432 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-372a6cb8-41f8-4d7c-9f42-b31aeaef13b9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:27.921851 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-372a6cb8-41f8-4d7c-9f42-b31aeaef13b9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:27.954456 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-372a6cb8-41f8-4d7c-9f42-b31aeaef13b9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:27.954941 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-372a6cb8-41f8-4d7c-9f42-b31aeaef13b9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:27.955375 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-372a6cb8-41f8-4d7c-9f42-b31aeaef13b9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:27.955821 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.objects.instance [None req-372a6cb8-41f8-4d7c-9f42-b31aeaef13b9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lazy-loading 'fault' on Instance uuid b3ed125b-4ca6-484d-9da6-d6e46fba2a13 {{(pid=125485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:44:28.000414 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-372a6cb8-41f8-4d7c-9f42-b31aeaef13b9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:28.007540 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-372a6cb8-41f8-4d7c-9f42-b31aeaef13b9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13" status: 200 len: 1331 microversion: 2.1 time: 0.099781 Oct 18 11:44:28.008105 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 283/546] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:27 2022] GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13 => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:28.341391 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-3f2733c1-4fec-46ef-a55f-50228281ee88 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:28.342001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-3f2733c1-4fec-46ef-a55f-50228281ee88 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:28.348305 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3f2733c1-4fec-46ef-a55f-50228281ee88 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:28.348781 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3f2733c1-4fec-46ef-a55f-50228281ee88 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:28.349290 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3f2733c1-4fec-46ef-a55f-50228281ee88 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:28.350833 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3f2733c1-4fec-46ef-a55f-50228281ee88 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:28.351290 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3f2733c1-4fec-46ef-a55f-50228281ee88 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:28.351707 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3f2733c1-4fec-46ef-a55f-50228281ee88 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:28.482336 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-3f2733c1-4fec-46ef-a55f-50228281ee88 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:28.491536 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-3f2733c1-4fec-46ef-a55f-50228281ee88 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1735 microversion: 2.1 time: 0.153471 Oct 18 11:44:28.492279 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 264/547] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:28 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:28.664079 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-985e7c97-c00a-415b-8f6e-dffd15bbd43d tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:28.664636 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-985e7c97-c00a-415b-8f6e-dffd15bbd43d tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:28.671090 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-985e7c97-c00a-415b-8f6e-dffd15bbd43d tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:28.671739 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-985e7c97-c00a-415b-8f6e-dffd15bbd43d tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:28.672005 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-985e7c97-c00a-415b-8f6e-dffd15bbd43d tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:28.672688 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-985e7c97-c00a-415b-8f6e-dffd15bbd43d tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:28.673157 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-985e7c97-c00a-415b-8f6e-dffd15bbd43d tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:28.673572 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-985e7c97-c00a-415b-8f6e-dffd15bbd43d tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:28.817063 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-985e7c97-c00a-415b-8f6e-dffd15bbd43d tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:28.825765 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-985e7c97-c00a-415b-8f6e-dffd15bbd43d tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1756 microversion: 2.1 time: 0.166110 Oct 18 11:44:28.826331 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 284/548] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:28 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:29.031643 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-b078cc22-fe92-4b99-9ef9-112b9bbe3b10 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:29.032159 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-b078cc22-fe92-4b99-9ef9-112b9bbe3b10 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:29.038019 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b078cc22-fe92-4b99-9ef9-112b9bbe3b10 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:29.038490 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b078cc22-fe92-4b99-9ef9-112b9bbe3b10 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:29.038917 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b078cc22-fe92-4b99-9ef9-112b9bbe3b10 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:29.039586 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b078cc22-fe92-4b99-9ef9-112b9bbe3b10 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:29.040038 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b078cc22-fe92-4b99-9ef9-112b9bbe3b10 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:29.040452 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b078cc22-fe92-4b99-9ef9-112b9bbe3b10 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:29.053810 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.wsgi [None req-b078cc22-fe92-4b99-9ef9-112b9bbe3b10 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] HTTP exception thrown: Instance b3ed125b-4ca6-484d-9da6-d6e46fba2a13 could not be found. Oct 18 11:44:29.055403 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-b078cc22-fe92-4b99-9ef9-112b9bbe3b10 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Request method failure captured: Oct 18 11:44:29.055403 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: request: GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13 HTTP/1.1 Oct 18 11:44:29.055403 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept: application/json Oct 18 11:44:29.055403 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept-Encoding: identity Oct 18 11:44:29.055403 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Connection: close Oct 18 11:44:29.055403 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Length: 0 Oct 18 11:44:29.055403 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Type: application/json Oct 18 11:44:29.055403 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Host: 10.222.0.17 Oct 18 11:44:29.055403 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Openstack-System-Scope: None Oct 18 11:44:29.055403 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: User-Agent: python-urllib3/1.26.12 Oct 18 11:44:29.055403 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Auth-Token: gAAAAABjTpC0QX2SvHowI5-vz58GDwpVMERgGiI-pqt2GQ4o1fdQFbeIrfuLVtcw55IWYTDh91fNo1KVKFcag_YfGjslSHmWVAe8eH9iiMTcKmdOtt4MUEPPWZ9OQcF5wlXB0WJP-XHDUtk0mAsVICaitUhEDH7cqfrNMho4FbOB0yKZgk6M4Ns Oct 18 11:44:29.055403 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Id: None Oct 18 11:44:29.055403 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Name: None Oct 18 11:44:29.055403 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Identity-Status: Confirmed Oct 18 11:44:29.055403 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Is-Admin-Project: True Oct 18 11:44:29.055403 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Id: default Oct 18 11:44:29.055403 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Name: Default Oct 18 11:44:29.055403 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Id: 633afaabbbff47a4a99ebc997e67b01a Oct 18 11:44:29.055403 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Name: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:44:29.055403 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Role: reader,member Oct 18 11:44:29.055403 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Roles: reader,member Oct 18 11:44:29.057020 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/633afaabbbff47a4a99ebc997e67b01a"}]}] Oct 18 11:44:29.057020 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:44:29.057020 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Id: 633afaabbbff47a4a99ebc997e67b01a Oct 18 11:44:29.057020 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:44:29.057020 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User: tempest-AttachVolumeNegativeTest-1091652349-project Oct 18 11:44:29.057020 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Id: default Oct 18 11:44:29.057020 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Name: Default Oct 18 11:44:29.057020 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Id: 916699a212eb4d8aa945f299ac0d4c96 Oct 18 11:44:29.057020 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Name: tempest-AttachVolumeNegativeTest-1091652349-project Oct 18 11:44:29.057020 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: method: > Oct 18 11:44:29.057020 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: exception: Instance b3ed125b-4ca6-484d-9da6-d6e46fba2a13 could not be found. Oct 18 11:44:29.057020 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: action_args: {'id': 'b3ed125b-4ca6-484d-9da6-d6e46fba2a13'} Oct 18 11:44:29.057838 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:44:29.057838 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:44:29.057838 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:44:29.057838 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:44:29.057838 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:44:29.057838 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:44:29.057838 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:44:29.057838 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:44:29.057838 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:44:29.057838 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:44:29.057838 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3ed125b-4ca6-484d-9da6-d6e46fba2a13 could not be found. Oct 18 11:44:29.057838 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:44:29.057838 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:44:29.057838 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:44:29.057838 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:44:29.057838 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:44:29.057838 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:44:29.057838 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:44:29.057838 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:44:29.057838 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:44:29.059273 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:44:29.059273 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 11:44:29.059273 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 11:44:29.059273 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:44:29.059273 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:44:29.059273 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:44:29.059273 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:44:29.059273 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3ed125b-4ca6-484d-9da6-d6e46fba2a13 could not be found. Oct 18 11:44:29.059273 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:44:29.059273 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:44:29.059273 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:44:29.059273 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:44:29.059273 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:44:29.059273 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:44:29.059273 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:44:29.059273 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:44:29.059273 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3ed125b-4ca6-484d-9da6-d6e46fba2a13 could not be found. Oct 18 11:44:29.059273 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:44:29.060529 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-b078cc22-fe92-4b99-9ef9-112b9bbe3b10 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Returning 404 to user: Instance b3ed125b-4ca6-484d-9da6-d6e46fba2a13 could not be found. {{(pid=125486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:44:29.060529 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-b078cc22-fe92-4b99-9ef9-112b9bbe3b10 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13" status: 404 len: 111 microversion: 2.1 time: 0.029092 Oct 18 11:44:29.060529 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 265/549] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:29 2022] GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:44:29.065654 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-25d09dee-793f-4d45-8961-12709c876a9a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '.version_select at 0x7f4be0041820>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:29.085015 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-25d09dee-793f-4d45-8961-12709c876a9a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1084490736" status: 202 len: 0 microversion: 2.1 time: 0.022224 Oct 18 11:44:29.085631 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 285/550] 10.222.0.17 () {58 vars in 1221 bytes} [Tue Oct 18 11:44:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1084490736 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 11:44:29.514966 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-0bca2a7e-7c38-41e6-83bb-c075f416f87f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:29.515575 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-0bca2a7e-7c38-41e6-83bb-c075f416f87f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:29.522021 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0bca2a7e-7c38-41e6-83bb-c075f416f87f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:29.522505 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0bca2a7e-7c38-41e6-83bb-c075f416f87f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:29.522940 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0bca2a7e-7c38-41e6-83bb-c075f416f87f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:29.523634 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0bca2a7e-7c38-41e6-83bb-c075f416f87f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:29.524082 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0bca2a7e-7c38-41e6-83bb-c075f416f87f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:29.524506 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0bca2a7e-7c38-41e6-83bb-c075f416f87f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:29.747033 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-0bca2a7e-7c38-41e6-83bb-c075f416f87f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:29.755215 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-0bca2a7e-7c38-41e6-83bb-c075f416f87f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1735 microversion: 2.1 time: 0.244134 Oct 18 11:44:29.755778 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 266/551] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:29 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1735 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:29.784701 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-8032df09-d849-4e8c-8775-e874704f54bc tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Action: 'create', calling method: .version_select at 0x7f4bdbe90940>, body: {"keypair": {"name": "tempest-keypair-1087759069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUXpU+cXJR4qfxdwD1zy9DLtMGS09RA5J+oXdraRisF+9v3Aq9rFj+RQCsIPvffMDq4Md9c9z9Nb5/7IcilkgpieLgUaXdMV7a0aSfjC/JssH5F2VmST+YAm6eZ50Er+Q=="}} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:44:29.800617 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.quota [None req-8032df09-d849-4e8c-8775-e874704f54bc tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Getting quotas for project 633afaabbbff47a4a99ebc997e67b01a. Resources: {'key_pairs'} {{(pid=125485) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:44:29.804980 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.quota [None req-8032df09-d849-4e8c-8775-e874704f54bc tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Getting quotas for user 916699a212eb4d8aa945f299ac0d4c96 and project 633afaabbbff47a4a99ebc997e67b01a. Resources: {'key_pairs'} {{(pid=125485) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:44:29.826308 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-8032df09-d849-4e8c-8775-e874704f54bc tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045891 Oct 18 11:44:29.826896 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 286/552] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Oct 18 11:44:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:44:29.850442 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-0cde9723-64a3-4535-a46e-dd25512ace18 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:29.851259 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-0cde9723-64a3-4535-a46e-dd25512ace18 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:29.858459 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0cde9723-64a3-4535-a46e-dd25512ace18 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:29.859158 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0cde9723-64a3-4535-a46e-dd25512ace18 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:29.859759 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0cde9723-64a3-4535-a46e-dd25512ace18 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:29.861300 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0cde9723-64a3-4535-a46e-dd25512ace18 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:29.861750 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0cde9723-64a3-4535-a46e-dd25512ace18 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:29.862195 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0cde9723-64a3-4535-a46e-dd25512ace18 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:30.074298 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-0cde9723-64a3-4535-a46e-dd25512ace18 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:30.082517 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-0cde9723-64a3-4535-a46e-dd25512ace18 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1756 microversion: 2.1 time: 0.236632 Oct 18 11:44:30.083082 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 267/553] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:29 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1756 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:30.778447 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-e05611be-7f27-4c19-8869-0bfbe7ed7e0f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:30.779357 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-e05611be-7f27-4c19-8869-0bfbe7ed7e0f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:30.786131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e05611be-7f27-4c19-8869-0bfbe7ed7e0f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:30.787812 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e05611be-7f27-4c19-8869-0bfbe7ed7e0f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:30.788588 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e05611be-7f27-4c19-8869-0bfbe7ed7e0f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:30.789297 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e05611be-7f27-4c19-8869-0bfbe7ed7e0f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:30.789719 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e05611be-7f27-4c19-8869-0bfbe7ed7e0f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:30.790147 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e05611be-7f27-4c19-8869-0bfbe7ed7e0f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:31.018783 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-e05611be-7f27-4c19-8869-0bfbe7ed7e0f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:31.029809 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-e05611be-7f27-4c19-8869-0bfbe7ed7e0f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1735 microversion: 2.1 time: 0.255204 Oct 18 11:44:31.031512 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 287/554] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:30 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1735 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:31.105868 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-97b75733-23ed-49b7-b8be-18d53b82d539 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:31.106672 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-97b75733-23ed-49b7-b8be-18d53b82d539 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:31.113078 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-97b75733-23ed-49b7-b8be-18d53b82d539 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:31.113557 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-97b75733-23ed-49b7-b8be-18d53b82d539 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:31.113983 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-97b75733-23ed-49b7-b8be-18d53b82d539 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:31.114671 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-97b75733-23ed-49b7-b8be-18d53b82d539 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:31.115117 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-97b75733-23ed-49b7-b8be-18d53b82d539 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:31.116083 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-97b75733-23ed-49b7-b8be-18d53b82d539 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:31.257522 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-bee3fe01-89d5-4edc-ad19-5880762b9b42 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-149696754", "imageRef": "a4917b56-ebe0-409a-894a-469900c12b94", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb24f3be-68a7-4ca5-a331-f9f5950dbafd"}], "security_groups": [{"name": "tempest-securitygroup--1384919107"}], "key_name": "tempest-keypair-1087759069", "user_data": "}} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:44:31.266061 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:44:31.266282 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-97b75733-23ed-49b7-b8be-18d53b82d539 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:31.275185 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-97b75733-23ed-49b7-b8be-18d53b82d539 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1756 microversion: 2.1 time: 0.173233 Oct 18 11:44:31.275771 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 268/555] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:31 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:31.364313 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.network.neutron [None req-bee3fe01-89d5-4edc-ad19-5880762b9b42 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] validate_networks() for [('eb24f3be-68a7-4ca5-a331-f9f5950dbafd', None, None, None, None, None)] {{(pid=125485) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 11:44:31.733047 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-bee3fe01-89d5-4edc-ad19-5880762b9b42 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Flavor limits 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 11:44:31.733493 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-bee3fe01-89d5-4edc-ad19-5880762b9b42 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Image limits 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 11:44:31.734114 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-bee3fe01-89d5-4edc-ad19-5880762b9b42 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Flavor pref 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 11:44:31.734517 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-bee3fe01-89d5-4edc-ad19-5880762b9b42 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Image pref 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 11:44:31.734927 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-bee3fe01-89d5-4edc-ad19-5880762b9b42 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 11:44:31.744422 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bee3fe01-89d5-4edc-ad19-5880762b9b42 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:31.744924 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bee3fe01-89d5-4edc-ad19-5880762b9b42 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:31.745359 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bee3fe01-89d5-4edc-ad19-5880762b9b42 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:31.746078 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bee3fe01-89d5-4edc-ad19-5880762b9b42 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:31.746529 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bee3fe01-89d5-4edc-ad19-5880762b9b42 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:31.746952 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bee3fe01-89d5-4edc-ad19-5880762b9b42 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:31.763451 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.quota [None req-bee3fe01-89d5-4edc-ad19-5880762b9b42 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Getting quotas for project 633afaabbbff47a4a99ebc997e67b01a. Resources: {'cores', 'instances', 'ram'} {{(pid=125485) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:44:31.767413 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.quota [None req-bee3fe01-89d5-4edc-ad19-5880762b9b42 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Getting quotas for user 916699a212eb4d8aa945f299ac0d4c96 and project 633afaabbbff47a4a99ebc997e67b01a. Resources: {'cores', 'instances', 'ram'} {{(pid=125485) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:44:31.778581 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-bee3fe01-89d5-4edc-ad19-5880762b9b42 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Going to run 1 instances... {{(pid=125485) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 11:44:31.780890 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-bee3fe01-89d5-4edc-ad19-5880762b9b42 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4917b56-ebe0-409a-894a-469900c12b94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125485) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 11:44:31.827903 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-bee3fe01-89d5-4edc-ad19-5880762b9b42 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.575191 Oct 18 11:44:31.828612 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 288/556] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Oct 18 11:44:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 11:44:31.840985 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-0e9129d0-bf45-4f69-8f6c-f0fe7f48bdf2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:31.841441 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-0e9129d0-bf45-4f69-8f6c-f0fe7f48bdf2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:31.899535 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-0e9129d0-bf45-4f69-8f6c-f0fe7f48bdf2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:31.906432 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-0e9129d0-bf45-4f69-8f6c-f0fe7f48bdf2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a" status: 200 len: 1241 microversion: 2.1 time: 0.069666 Oct 18 11:44:31.907004 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 269/557] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:31 2022] GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:32.054403 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-28886ab8-2994-487e-a711-17a7103644a4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:32.055254 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-28886ab8-2994-487e-a711-17a7103644a4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:32.061482 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-28886ab8-2994-487e-a711-17a7103644a4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:32.061965 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-28886ab8-2994-487e-a711-17a7103644a4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:32.062377 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-28886ab8-2994-487e-a711-17a7103644a4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:32.063067 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-28886ab8-2994-487e-a711-17a7103644a4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:32.063508 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-28886ab8-2994-487e-a711-17a7103644a4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:32.063927 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-28886ab8-2994-487e-a711-17a7103644a4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:32.210814 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-28886ab8-2994-487e-a711-17a7103644a4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:32.219443 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-28886ab8-2994-487e-a711-17a7103644a4 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1735 microversion: 2.1 time: 0.168823 Oct 18 11:44:32.220164 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 289/558] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:32 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:32.299573 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-d59c4862-e7fa-4047-9776-22d41dcae486 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:32.300170 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-d59c4862-e7fa-4047-9776-22d41dcae486 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:32.307018 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d59c4862-e7fa-4047-9776-22d41dcae486 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:32.307490 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d59c4862-e7fa-4047-9776-22d41dcae486 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:32.307913 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d59c4862-e7fa-4047-9776-22d41dcae486 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:32.308593 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d59c4862-e7fa-4047-9776-22d41dcae486 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:32.309068 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d59c4862-e7fa-4047-9776-22d41dcae486 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:32.309486 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d59c4862-e7fa-4047-9776-22d41dcae486 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:32.548313 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-d59c4862-e7fa-4047-9776-22d41dcae486 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:32.556579 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-d59c4862-e7fa-4047-9776-22d41dcae486 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1756 microversion: 2.1 time: 0.260980 Oct 18 11:44:32.557187 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 270/559] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:32 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1756 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:32.930760 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-930aa025-ad2e-47dc-bb23-f03d064a9022 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:32.931360 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-930aa025-ad2e-47dc-bb23-f03d064a9022 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:32.937629 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-930aa025-ad2e-47dc-bb23-f03d064a9022 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:32.938233 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-930aa025-ad2e-47dc-bb23-f03d064a9022 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:32.938727 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-930aa025-ad2e-47dc-bb23-f03d064a9022 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:32.939333 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-930aa025-ad2e-47dc-bb23-f03d064a9022 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:32.939784 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-930aa025-ad2e-47dc-bb23-f03d064a9022 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:32.940199 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-930aa025-ad2e-47dc-bb23-f03d064a9022 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:33.000626 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-930aa025-ad2e-47dc-bb23-f03d064a9022 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:33.008650 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-930aa025-ad2e-47dc-bb23-f03d064a9022 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a" status: 200 len: 1293 microversion: 2.1 time: 0.081714 Oct 18 11:44:33.009205 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 290/560] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:32 2022] GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a => generated 1293 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:33.244131 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-990b41a1-c40b-4677-8e61-8b2182aa07e7 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:33.244719 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-990b41a1-c40b-4677-8e61-8b2182aa07e7 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:33.250660 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-990b41a1-c40b-4677-8e61-8b2182aa07e7 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:33.251133 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-990b41a1-c40b-4677-8e61-8b2182aa07e7 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:33.251561 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-990b41a1-c40b-4677-8e61-8b2182aa07e7 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:33.252249 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-990b41a1-c40b-4677-8e61-8b2182aa07e7 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:33.252670 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-990b41a1-c40b-4677-8e61-8b2182aa07e7 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:33.253117 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-990b41a1-c40b-4677-8e61-8b2182aa07e7 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:33.385616 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-990b41a1-c40b-4677-8e61-8b2182aa07e7 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:33.393792 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-990b41a1-c40b-4677-8e61-8b2182aa07e7 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1735 microversion: 2.1 time: 0.154148 Oct 18 11:44:33.394355 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 271/561] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:33 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:33.579613 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-8b2d4dbf-0c2d-41c7-aba0-f4c4f1c3d9e4 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:33.580127 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-8b2d4dbf-0c2d-41c7-aba0-f4c4f1c3d9e4 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:33.586873 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8b2d4dbf-0c2d-41c7-aba0-f4c4f1c3d9e4 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:33.587351 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8b2d4dbf-0c2d-41c7-aba0-f4c4f1c3d9e4 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:33.587780 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8b2d4dbf-0c2d-41c7-aba0-f4c4f1c3d9e4 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:33.588460 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8b2d4dbf-0c2d-41c7-aba0-f4c4f1c3d9e4 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:33.588930 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8b2d4dbf-0c2d-41c7-aba0-f4c4f1c3d9e4 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:33.589350 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8b2d4dbf-0c2d-41c7-aba0-f4c4f1c3d9e4 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:33.728558 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-8b2d4dbf-0c2d-41c7-aba0-f4c4f1c3d9e4 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:33.736836 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-8b2d4dbf-0c2d-41c7-aba0-f4c4f1c3d9e4 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1756 microversion: 2.1 time: 0.161168 Oct 18 11:44:33.737426 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 291/562] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:33 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:34.032248 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-dede27c3-fbb5-4954-8010-d3b82d7f4ab9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:34.032878 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-dede27c3-fbb5-4954-8010-d3b82d7f4ab9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:34.038839 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dede27c3-fbb5-4954-8010-d3b82d7f4ab9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:34.039328 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dede27c3-fbb5-4954-8010-d3b82d7f4ab9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:34.039760 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dede27c3-fbb5-4954-8010-d3b82d7f4ab9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:34.040444 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dede27c3-fbb5-4954-8010-d3b82d7f4ab9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:34.040922 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dede27c3-fbb5-4954-8010-d3b82d7f4ab9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:34.041347 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dede27c3-fbb5-4954-8010-d3b82d7f4ab9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:34.105839 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-dede27c3-fbb5-4954-8010-d3b82d7f4ab9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:34.113444 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-dede27c3-fbb5-4954-8010-d3b82d7f4ab9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a" status: 200 len: 1301 microversion: 2.1 time: 0.085062 Oct 18 11:44:34.114011 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 272/563] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:34 2022] GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a => generated 1301 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:34.417682 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ac562603-34ad-4186-83a8-6ce03f8e6911 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:34.418468 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-ac562603-34ad-4186-83a8-6ce03f8e6911 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:34.425503 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ac562603-34ad-4186-83a8-6ce03f8e6911 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:34.426259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ac562603-34ad-4186-83a8-6ce03f8e6911 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:34.426981 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ac562603-34ad-4186-83a8-6ce03f8e6911 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:34.428476 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ac562603-34ad-4186-83a8-6ce03f8e6911 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:34.429099 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ac562603-34ad-4186-83a8-6ce03f8e6911 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:34.429674 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ac562603-34ad-4186-83a8-6ce03f8e6911 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:34.569451 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-ac562603-34ad-4186-83a8-6ce03f8e6911 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:34.577896 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-ac562603-34ad-4186-83a8-6ce03f8e6911 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1715 microversion: 2.1 time: 0.163921 Oct 18 11:44:34.578479 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 292/564] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:34 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1715 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:34.694744 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-e5cbd12f-7b41-4c27-8b8b-8fc5233f8e9d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:34.695314 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-e5cbd12f-7b41-4c27-8b8b-8fc5233f8e9d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:34.701243 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e5cbd12f-7b41-4c27-8b8b-8fc5233f8e9d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:34.701723 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e5cbd12f-7b41-4c27-8b8b-8fc5233f8e9d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:34.702168 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e5cbd12f-7b41-4c27-8b8b-8fc5233f8e9d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:34.702847 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e5cbd12f-7b41-4c27-8b8b-8fc5233f8e9d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:34.703311 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e5cbd12f-7b41-4c27-8b8b-8fc5233f8e9d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:34.703713 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e5cbd12f-7b41-4c27-8b8b-8fc5233f8e9d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:34.761267 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-6ced9b21-d608-4522-9ca5-ca434c94926a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:34.762319 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-6ced9b21-d608-4522-9ca5-ca434c94926a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:34.768317 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6ced9b21-d608-4522-9ca5-ca434c94926a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:34.768961 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6ced9b21-d608-4522-9ca5-ca434c94926a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:34.769501 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6ced9b21-d608-4522-9ca5-ca434c94926a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:34.770451 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6ced9b21-d608-4522-9ca5-ca434c94926a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:34.770974 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6ced9b21-d608-4522-9ca5-ca434c94926a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:34.771522 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6ced9b21-d608-4522-9ca5-ca434c94926a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:34.809378 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.wsgi [None req-e5cbd12f-7b41-4c27-8b8b-8fc5233f8e9d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] HTTP exception thrown: Cannot 'detach_volume' instance 3f737271-603e-4448-b37d-4a5ae83dd052 while it is in vm_state rescued Oct 18 11:44:34.811267 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-e5cbd12f-7b41-4c27-8b8b-8fc5233f8e9d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Request method failure captured: Oct 18 11:44:34.811267 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: request: DELETE /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052/os-volume_attachments/58fb065d-ccab-4904-98fe-c598c0060524 HTTP/1.1 Oct 18 11:44:34.811267 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept: application/json Oct 18 11:44:34.811267 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept-Encoding: identity Oct 18 11:44:34.811267 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Connection: close Oct 18 11:44:34.811267 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Length: 0 Oct 18 11:44:34.811267 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Type: application/json Oct 18 11:44:34.811267 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Host: 10.222.0.17 Oct 18 11:44:34.811267 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Openstack-System-Scope: None Oct 18 11:44:34.811267 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: User-Agent: python-urllib3/1.26.12 Oct 18 11:44:34.811267 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Auth-Token: gAAAAABjTpCyITCOuZ_3FbMTs3DhKEW_OwwcrGod2a_lrP_UNCZrETSVqjf-o7Z_Za1EvdYUbGePPsNMV1lYEK1fAp16Ng8WUSaI3Prsxzq9uX4zhASpgMp9MLYGWUxlDXz9kmC1mhrxhXDkhFi9KB2Jd7SlJFgu7FNGvZ6QYPd5pDBE_uJGE7M Oct 18 11:44:34.811267 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Id: None Oct 18 11:44:34.811267 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Name: None Oct 18 11:44:34.811267 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Identity-Status: Confirmed Oct 18 11:44:34.811267 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Is-Admin-Project: True Oct 18 11:44:34.811267 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Id: default Oct 18 11:44:34.811267 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Name: Default Oct 18 11:44:34.811267 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Id: cd52252f24114465af9bdf6e6fe68b76 Oct 18 11:44:34.811267 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1678509525 Oct 18 11:44:34.811267 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Role: reader,member Oct 18 11:44:34.811267 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Roles: reader,member Oct 18 11:44:34.812555 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd52252f24114465af9bdf6e6fe68b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cd52252f24114465af9bdf6e6fe68b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cd52252f24114465af9bdf6e6fe68b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd52252f24114465af9bdf6e6fe68b76"}]}] Oct 18 11:44:34.812555 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1678509525 Oct 18 11:44:34.812555 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Id: cd52252f24114465af9bdf6e6fe68b76 Oct 18 11:44:34.812555 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1678509525 Oct 18 11:44:34.812555 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User: tempest-ServerRescueNegativeTestJSON-1678509525-project Oct 18 11:44:34.812555 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Id: default Oct 18 11:44:34.812555 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Name: Default Oct 18 11:44:34.812555 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Id: 1f624c36a3574b61bd17d5d73af71916 Oct 18 11:44:34.812555 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1678509525-project Oct 18 11:44:34.812555 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: method: > Oct 18 11:44:34.812555 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: exception: Cannot 'detach_volume' instance 3f737271-603e-4448-b37d-4a5ae83dd052 while it is in vm_state rescued Oct 18 11:44:34.813287 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: action_args: {'server_id': '3f737271-603e-4448-b37d-4a5ae83dd052', 'id': '58fb065d-ccab-4904-98fe-c598c0060524'} Oct 18 11:44:34.813287 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:44:34.813287 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:44:34.813287 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 18 11:44:34.813287 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 18 11:44:34.813287 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 11:44:34.813287 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 11:44:34.813287 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 11:44:34.813287 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 11:44:34.813287 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3f737271-603e-4448-b37d-4a5ae83dd052 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 18 11:44:34.813287 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:44:34.813287 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:44:34.813287 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:44:34.813287 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:44:34.813287 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:44:34.813287 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:44:34.813287 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:44:34.813287 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:44:34.813287 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:44:34.813287 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:44:34.814701 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 18 11:44:34.814701 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 11:44:34.814701 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 11:44:34.814701 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 11:44:34.814701 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3f737271-603e-4448-b37d-4a5ae83dd052 while it is in vm_state rescued Oct 18 11:44:34.814701 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:44:34.814701 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:44:34.814701 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:44:34.814701 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:44:34.814701 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:44:34.814701 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:44:34.814701 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:44:34.814701 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:44:34.814701 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3f737271-603e-4448-b37d-4a5ae83dd052 while it is in vm_state rescued Oct 18 11:44:34.814701 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:44:34.816826 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-e5cbd12f-7b41-4c27-8b8b-8fc5233f8e9d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Returning 409 to user: Cannot 'detach_volume' instance 3f737271-603e-4448-b37d-4a5ae83dd052 while it is in vm_state rescued {{(pid=125486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:44:34.817884 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-e5cbd12f-7b41-4c27-8b8b-8fc5233f8e9d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052/os-volume_attachments/58fb065d-ccab-4904-98fe-c598c0060524" status: 409 len: 152 microversion: 2.1 time: 0.127443 Oct 18 11:44:34.819008 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 273/565] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Oct 18 11:44:34 2022] DELETE /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052/os-volume_attachments/58fb065d-ccab-4904-98fe-c598c0060524 => generated 152 bytes in 129 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 11:44:34.828461 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-4156e3db-ff29-4f20-9cc4-3450ca2b4c93 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:44:34.829183 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-4156e3db-ff29-4f20-9cc4-3450ca2b4c93 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:34.837665 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4156e3db-ff29-4f20-9cc4-3450ca2b4c93 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:34.838156 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4156e3db-ff29-4f20-9cc4-3450ca2b4c93 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:34.838582 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4156e3db-ff29-4f20-9cc4-3450ca2b4c93 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:34.839337 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4156e3db-ff29-4f20-9cc4-3450ca2b4c93 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:34.839794 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4156e3db-ff29-4f20-9cc4-3450ca2b4c93 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:34.840214 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4156e3db-ff29-4f20-9cc4-3450ca2b4c93 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:34.926690 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-4156e3db-ff29-4f20-9cc4-3450ca2b4c93 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "POST /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052/action" status: 202 len: 0 microversion: 2.1 time: 0.102317 Oct 18 11:44:34.933801 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 274/566] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Oct 18 11:44:34 2022] POST /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 11:44:34.942959 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-81f286da-3f4b-4e74-98fa-6459f8f8d07b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:34.945064 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-81f286da-3f4b-4e74-98fa-6459f8f8d07b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:34.953788 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-81f286da-3f4b-4e74-98fa-6459f8f8d07b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:34.954921 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-81f286da-3f4b-4e74-98fa-6459f8f8d07b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:34.955901 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-81f286da-3f4b-4e74-98fa-6459f8f8d07b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:34.956740 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-81f286da-3f4b-4e74-98fa-6459f8f8d07b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:34.957313 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-81f286da-3f4b-4e74-98fa-6459f8f8d07b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:34.957777 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-81f286da-3f4b-4e74-98fa-6459f8f8d07b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:34.958443 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-6ced9b21-d608-4522-9ca5-ca434c94926a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:34.971707 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-6ced9b21-d608-4522-9ca5-ca434c94926a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1756 microversion: 2.1 time: 0.214438 Oct 18 11:44:34.972952 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 293/567] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:34 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1756 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:35.136888 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-a1ab7d6f-57dd-4fc4-a249-19d0fff22552 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:35.137692 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-a1ab7d6f-57dd-4fc4-a249-19d0fff22552 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:35.143618 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a1ab7d6f-57dd-4fc4-a249-19d0fff22552 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:35.144097 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a1ab7d6f-57dd-4fc4-a249-19d0fff22552 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:35.144527 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a1ab7d6f-57dd-4fc4-a249-19d0fff22552 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:35.145247 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a1ab7d6f-57dd-4fc4-a249-19d0fff22552 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:35.145724 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a1ab7d6f-57dd-4fc4-a249-19d0fff22552 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:35.146284 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a1ab7d6f-57dd-4fc4-a249-19d0fff22552 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:35.176899 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:44:35.232011 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-81f286da-3f4b-4e74-98fa-6459f8f8d07b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:35.240672 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-81f286da-3f4b-4e74-98fa-6459f8f8d07b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1723 microversion: 2.1 time: 0.305447 Oct 18 11:44:35.241560 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 275/568] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:34 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1723 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:35.485560 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-a1ab7d6f-57dd-4fc4-a249-19d0fff22552 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:35.493504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-a1ab7d6f-57dd-4fc4-a249-19d0fff22552 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a" status: 200 len: 1299 microversion: 2.1 time: 0.360571 Oct 18 11:44:35.494859 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 294/569] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:35 2022] GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a => generated 1299 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:44:35.998304 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-db8f9536-d237-418d-8d69-4f33fb0da5ca tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:35.998996 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-db8f9536-d237-418d-8d69-4f33fb0da5ca tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:36.005235 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-db8f9536-d237-418d-8d69-4f33fb0da5ca tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:36.006306 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-db8f9536-d237-418d-8d69-4f33fb0da5ca tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:36.006806 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-db8f9536-d237-418d-8d69-4f33fb0da5ca tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:36.007571 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-db8f9536-d237-418d-8d69-4f33fb0da5ca tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:36.008088 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-db8f9536-d237-418d-8d69-4f33fb0da5ca tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:36.008570 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-db8f9536-d237-418d-8d69-4f33fb0da5ca tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:36.014580 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:44:36.228876 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-db8f9536-d237-418d-8d69-4f33fb0da5ca tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:36.239935 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-db8f9536-d237-418d-8d69-4f33fb0da5ca tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1756 microversion: 2.1 time: 0.245447 Oct 18 11:44:36.240537 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 276/570] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:35 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1756 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:36.253019 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-8fd70150-6a99-4ccc-9510-f5f4ad3a118f req-635f9f66-f90c-49c4-9bd7-9b747b063b66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a", "tag": "57038a22-7ba2-4f5b-9e92-8aaac3f8c774"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:44:36.264001 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-8fd70150-6a99-4ccc-9510-f5f4ad3a118f req-635f9f66-f90c-49c4-9bd7-9b747b063b66 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:36.264443 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-798a0f66-7abe-40a7-9d10-e50642f89866 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:36.265070 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-8fd70150-6a99-4ccc-9510-f5f4ad3a118f req-635f9f66-f90c-49c4-9bd7-9b747b063b66 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:36.265342 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-798a0f66-7abe-40a7-9d10-e50642f89866 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:36.265922 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-8fd70150-6a99-4ccc-9510-f5f4ad3a118f req-635f9f66-f90c-49c4-9bd7-9b747b063b66 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:36.273671 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-798a0f66-7abe-40a7-9d10-e50642f89866 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:36.274284 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-798a0f66-7abe-40a7-9d10-e50642f89866 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:36.274809 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-798a0f66-7abe-40a7-9d10-e50642f89866 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:36.275738 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-798a0f66-7abe-40a7-9d10-e50642f89866 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:36.276441 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-798a0f66-7abe-40a7-9d10-e50642f89866 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:36.277099 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-798a0f66-7abe-40a7-9d10-e50642f89866 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:36.279823 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-8fd70150-6a99-4ccc-9510-f5f4ad3a118f req-635f9f66-f90c-49c4-9bd7-9b747b063b66 service nova] Creating event network-changed:57038a22-7ba2-4f5b-9e92-8aaac3f8c774 for instance 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a on hv-cinder-81558 Oct 18 11:44:36.285914 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-8fd70150-6a99-4ccc-9510-f5f4ad3a118f req-635f9f66-f90c-49c4-9bd7-9b747b063b66 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036558 Oct 18 11:44:36.286596 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 295/571] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:44:36.411702 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-798a0f66-7abe-40a7-9d10-e50642f89866 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:36.419875 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-798a0f66-7abe-40a7-9d10-e50642f89866 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1723 microversion: 2.1 time: 0.159213 Oct 18 11:44:36.420431 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 277/572] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:36 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:36.522480 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-0572e676-ce6b-40b2-9d8c-bb16dca6f30c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:36.523197 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-0572e676-ce6b-40b2-9d8c-bb16dca6f30c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:36.529231 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0572e676-ce6b-40b2-9d8c-bb16dca6f30c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:36.529704 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0572e676-ce6b-40b2-9d8c-bb16dca6f30c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:36.530133 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0572e676-ce6b-40b2-9d8c-bb16dca6f30c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:36.530813 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0572e676-ce6b-40b2-9d8c-bb16dca6f30c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:36.531256 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0572e676-ce6b-40b2-9d8c-bb16dca6f30c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:36.531671 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0572e676-ce6b-40b2-9d8c-bb16dca6f30c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:36.660252 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-0572e676-ce6b-40b2-9d8c-bb16dca6f30c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:36.667752 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-0572e676-ce6b-40b2-9d8c-bb16dca6f30c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a" status: 200 len: 1367 microversion: 2.1 time: 0.149930 Oct 18 11:44:36.668310 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 296/573] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:36 2022] GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:44:37.276951 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-49e94544-0854-40ab-9720-9bbdfe9fa43e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:37.277546 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-49e94544-0854-40ab-9720-9bbdfe9fa43e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:37.279840 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_api:SELECT=84 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:44:37.285095 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-49e94544-0854-40ab-9720-9bbdfe9fa43e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:37.285567 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-49e94544-0854-40ab-9720-9bbdfe9fa43e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:37.285994 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-49e94544-0854-40ab-9720-9bbdfe9fa43e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:37.286674 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-49e94544-0854-40ab-9720-9bbdfe9fa43e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:37.287709 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-49e94544-0854-40ab-9720-9bbdfe9fa43e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:37.288124 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-49e94544-0854-40ab-9720-9bbdfe9fa43e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:37.433711 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-49e94544-0854-40ab-9720-9bbdfe9fa43e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:37.442072 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-49e94544-0854-40ab-9720-9bbdfe9fa43e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1756 microversion: 2.1 time: 0.168984 Oct 18 11:44:37.442667 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 278/574] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:37 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:37.443280 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-1a432ab6-76dd-42ea-9dfd-8a8cc1cf7cd8 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:37.443888 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-1a432ab6-76dd-42ea-9dfd-8a8cc1cf7cd8 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:37.449936 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1a432ab6-76dd-42ea-9dfd-8a8cc1cf7cd8 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:37.450418 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1a432ab6-76dd-42ea-9dfd-8a8cc1cf7cd8 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:37.450851 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1a432ab6-76dd-42ea-9dfd-8a8cc1cf7cd8 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:37.451537 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1a432ab6-76dd-42ea-9dfd-8a8cc1cf7cd8 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:37.452020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1a432ab6-76dd-42ea-9dfd-8a8cc1cf7cd8 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:37.452441 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1a432ab6-76dd-42ea-9dfd-8a8cc1cf7cd8 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:37.579430 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-1a432ab6-76dd-42ea-9dfd-8a8cc1cf7cd8 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:37.588637 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-1a432ab6-76dd-42ea-9dfd-8a8cc1cf7cd8 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1723 microversion: 2.1 time: 0.149115 Oct 18 11:44:37.589430 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 297/575] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:37 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:44:37.690967 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-d674cf2f-ac42-4f91-9f70-bd532117609f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:37.691626 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-d674cf2f-ac42-4f91-9f70-bd532117609f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:37.698245 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d674cf2f-ac42-4f91-9f70-bd532117609f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:37.698815 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d674cf2f-ac42-4f91-9f70-bd532117609f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:37.699312 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d674cf2f-ac42-4f91-9f70-bd532117609f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:37.700024 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d674cf2f-ac42-4f91-9f70-bd532117609f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:37.700471 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d674cf2f-ac42-4f91-9f70-bd532117609f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:37.701029 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d674cf2f-ac42-4f91-9f70-bd532117609f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:37.902684 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-d674cf2f-ac42-4f91-9f70-bd532117609f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:37.910581 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-d674cf2f-ac42-4f91-9f70-bd532117609f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a" status: 200 len: 1367 microversion: 2.1 time: 0.223556 Oct 18 11:44:37.911158 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 279/576] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:37 2022] GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:38.465774 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-408a09ee-bea8-40bd-8f36-a017b539eeea tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:38.466372 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-408a09ee-bea8-40bd-8f36-a017b539eeea tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:38.472231 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-408a09ee-bea8-40bd-8f36-a017b539eeea tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:38.472707 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-408a09ee-bea8-40bd-8f36-a017b539eeea tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:38.473170 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-408a09ee-bea8-40bd-8f36-a017b539eeea tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:38.473842 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-408a09ee-bea8-40bd-8f36-a017b539eeea tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:38.474920 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-408a09ee-bea8-40bd-8f36-a017b539eeea tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:38.475214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-408a09ee-bea8-40bd-8f36-a017b539eeea tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:38.611604 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-c57d1b40-7322-45fd-a22c-259e7a5f6a82 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:38.612253 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-c57d1b40-7322-45fd-a22c-259e7a5f6a82 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:38.616682 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-408a09ee-bea8-40bd-8f36-a017b539eeea tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:38.618809 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c57d1b40-7322-45fd-a22c-259e7a5f6a82 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:38.619283 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c57d1b40-7322-45fd-a22c-259e7a5f6a82 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:38.619707 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c57d1b40-7322-45fd-a22c-259e7a5f6a82 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:38.620390 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c57d1b40-7322-45fd-a22c-259e7a5f6a82 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:38.620922 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c57d1b40-7322-45fd-a22c-259e7a5f6a82 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:38.621336 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c57d1b40-7322-45fd-a22c-259e7a5f6a82 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:38.625250 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-408a09ee-bea8-40bd-8f36-a017b539eeea tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1759 microversion: 2.1 time: 0.163312 Oct 18 11:44:38.625814 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 298/577] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:38 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:38.749301 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-c57d1b40-7322-45fd-a22c-259e7a5f6a82 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:38.757484 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-c57d1b40-7322-45fd-a22c-259e7a5f6a82 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1729 microversion: 2.1 time: 0.149811 Oct 18 11:44:38.758040 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 280/578] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:38 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:44:38.779927 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-a44c0d04-0f2d-4ee3-a0fd-0f82f8ac704c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:38.780408 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-a44c0d04-0f2d-4ee3-a0fd-0f82f8ac704c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:38.786266 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a44c0d04-0f2d-4ee3-a0fd-0f82f8ac704c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:38.786740 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a44c0d04-0f2d-4ee3-a0fd-0f82f8ac704c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:38.787794 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a44c0d04-0f2d-4ee3-a0fd-0f82f8ac704c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:38.788467 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a44c0d04-0f2d-4ee3-a0fd-0f82f8ac704c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:38.788934 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a44c0d04-0f2d-4ee3-a0fd-0f82f8ac704c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:38.789350 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a44c0d04-0f2d-4ee3-a0fd-0f82f8ac704c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:38.865119 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-a44c0d04-0f2d-4ee3-a0fd-0f82f8ac704c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088850 Oct 18 11:44:38.865736 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 299/579] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Oct 18 11:44:38 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:44:38.938758 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-e52efbe6-79df-4bb8-8079-1e026cb958a2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:38.939373 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-e52efbe6-79df-4bb8-8079-1e026cb958a2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:38.954356 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e52efbe6-79df-4bb8-8079-1e026cb958a2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:38.954760 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e52efbe6-79df-4bb8-8079-1e026cb958a2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:38.955189 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e52efbe6-79df-4bb8-8079-1e026cb958a2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:38.955884 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e52efbe6-79df-4bb8-8079-1e026cb958a2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:38.956359 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e52efbe6-79df-4bb8-8079-1e026cb958a2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:38.956796 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e52efbe6-79df-4bb8-8079-1e026cb958a2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:39.171026 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-e52efbe6-79df-4bb8-8079-1e026cb958a2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:39.179655 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-e52efbe6-79df-4bb8-8079-1e026cb958a2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a" status: 200 len: 1367 microversion: 2.1 time: 0.244650 Oct 18 11:44:39.185958 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 281/580] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:38 2022] GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:39.761768 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-749f0158-46f4-4363-88ab-10062fbf8868 req-2f9e01fb-f459-4ee1-81dc-d1f40c5d3dfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f737271-603e-4448-b37d-4a5ae83dd052", "tag": "068b5a44-602c-41f5-93ae-92aab177d2c9"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:44:39.771462 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-749f0158-46f4-4363-88ab-10062fbf8868 req-2f9e01fb-f459-4ee1-81dc-d1f40c5d3dfe service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:39.771934 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-749f0158-46f4-4363-88ab-10062fbf8868 req-2f9e01fb-f459-4ee1-81dc-d1f40c5d3dfe service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:39.772355 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-749f0158-46f4-4363-88ab-10062fbf8868 req-2f9e01fb-f459-4ee1-81dc-d1f40c5d3dfe service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:39.783712 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-749f0158-46f4-4363-88ab-10062fbf8868 req-2f9e01fb-f459-4ee1-81dc-d1f40c5d3dfe service nova] Creating event network-changed:068b5a44-602c-41f5-93ae-92aab177d2c9 for instance 3f737271-603e-4448-b37d-4a5ae83dd052 on hv-cinder-81558 Oct 18 11:44:39.789694 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-749f0158-46f4-4363-88ab-10062fbf8868 req-2f9e01fb-f459-4ee1-81dc-d1f40c5d3dfe service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031959 Oct 18 11:44:39.790305 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 300/581] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:44:40.202503 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-32fd7016-e67d-4022-b8e3-df5cb11d8531 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:40.203122 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-32fd7016-e67d-4022-b8e3-df5cb11d8531 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:40.209972 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-32fd7016-e67d-4022-b8e3-df5cb11d8531 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:40.210449 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-32fd7016-e67d-4022-b8e3-df5cb11d8531 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:40.210876 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-32fd7016-e67d-4022-b8e3-df5cb11d8531 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:40.211561 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-32fd7016-e67d-4022-b8e3-df5cb11d8531 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:40.212033 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-32fd7016-e67d-4022-b8e3-df5cb11d8531 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:40.212448 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-32fd7016-e67d-4022-b8e3-df5cb11d8531 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:40.342488 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-32fd7016-e67d-4022-b8e3-df5cb11d8531 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:40.350820 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-32fd7016-e67d-4022-b8e3-df5cb11d8531 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a" status: 200 len: 1367 microversion: 2.1 time: 0.152086 Oct 18 11:44:40.351438 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 282/582] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:40 2022] GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:41.375856 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-b7c8e451-fd01-4333-8716-91c691b8de15 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:41.376554 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-b7c8e451-fd01-4333-8716-91c691b8de15 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:41.384166 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b7c8e451-fd01-4333-8716-91c691b8de15 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:41.384692 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b7c8e451-fd01-4333-8716-91c691b8de15 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:41.385195 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b7c8e451-fd01-4333-8716-91c691b8de15 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:41.385876 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b7c8e451-fd01-4333-8716-91c691b8de15 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:41.386331 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b7c8e451-fd01-4333-8716-91c691b8de15 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:41.386762 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b7c8e451-fd01-4333-8716-91c691b8de15 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:41.521360 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-b7c8e451-fd01-4333-8716-91c691b8de15 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:41.529002 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-b7c8e451-fd01-4333-8716-91c691b8de15 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a" status: 200 len: 1367 microversion: 2.1 time: 0.158307 Oct 18 11:44:41.529573 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 301/583] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:41 2022] GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:41.803991 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-d8312dc9-55ee-48a0-adf5-e4e17c070b97 req-baed558a-b427-415d-ab83-90437ace2146 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f737271-603e-4448-b37d-4a5ae83dd052", "tag": "068b5a44-602c-41f5-93ae-92aab177d2c9"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:44:41.813697 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-d8312dc9-55ee-48a0-adf5-e4e17c070b97 req-baed558a-b427-415d-ab83-90437ace2146 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:41.814163 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-d8312dc9-55ee-48a0-adf5-e4e17c070b97 req-baed558a-b427-415d-ab83-90437ace2146 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:41.814587 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-d8312dc9-55ee-48a0-adf5-e4e17c070b97 req-baed558a-b427-415d-ab83-90437ace2146 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:41.825774 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-d8312dc9-55ee-48a0-adf5-e4e17c070b97 req-baed558a-b427-415d-ab83-90437ace2146 service nova] Creating event network-changed:068b5a44-602c-41f5-93ae-92aab177d2c9 for instance 3f737271-603e-4448-b37d-4a5ae83dd052 on hv-cinder-81558 Oct 18 11:44:41.830597 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-d8312dc9-55ee-48a0-adf5-e4e17c070b97 req-baed558a-b427-415d-ab83-90437ace2146 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030774 Oct 18 11:44:41.831271 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 283/584] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:44:42.551530 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-bb45aa48-5324-4426-b19e-9dd2db815e64 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:42.552150 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-bb45aa48-5324-4426-b19e-9dd2db815e64 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:42.554682 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell0:SELECT=2 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:44:42.555518 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell0:SELECT=10 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:44:42.561338 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bb45aa48-5324-4426-b19e-9dd2db815e64 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:42.561816 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bb45aa48-5324-4426-b19e-9dd2db815e64 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:42.562252 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bb45aa48-5324-4426-b19e-9dd2db815e64 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:42.562941 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bb45aa48-5324-4426-b19e-9dd2db815e64 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:42.563387 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bb45aa48-5324-4426-b19e-9dd2db815e64 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:42.563807 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bb45aa48-5324-4426-b19e-9dd2db815e64 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:42.692310 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-bb45aa48-5324-4426-b19e-9dd2db815e64 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:42.700821 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-bb45aa48-5324-4426-b19e-9dd2db815e64 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a" status: 200 len: 1367 microversion: 2.1 time: 0.153161 Oct 18 11:44:42.701433 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 302/585] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:42 2022] GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:42.948495 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell0:SELECT=2 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:44:42.953571 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-a72d7265-6608-4f69-80e4-6d19e9c8148c req-d34ddc41-6bee-4437-90ad-983aca0b4ff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a", "name": "network-vif-plugged", "status": "completed", "tag": "57038a22-7ba2-4f5b-9e92-8aaac3f8c774"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:44:42.964836 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-a72d7265-6608-4f69-80e4-6d19e9c8148c req-d34ddc41-6bee-4437-90ad-983aca0b4ff5 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:42.965435 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-a72d7265-6608-4f69-80e4-6d19e9c8148c req-d34ddc41-6bee-4437-90ad-983aca0b4ff5 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:42.965931 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-a72d7265-6608-4f69-80e4-6d19e9c8148c req-d34ddc41-6bee-4437-90ad-983aca0b4ff5 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:42.976777 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-a72d7265-6608-4f69-80e4-6d19e9c8148c req-d34ddc41-6bee-4437-90ad-983aca0b4ff5 service nova] Creating event network-vif-plugged:57038a22-7ba2-4f5b-9e92-8aaac3f8c774 for instance 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a on hv-cinder-81558 Oct 18 11:44:42.981741 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-a72d7265-6608-4f69-80e4-6d19e9c8148c req-d34ddc41-6bee-4437-90ad-983aca0b4ff5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033998 Oct 18 11:44:42.982325 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 284/586] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:44:43.724350 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-2b6d2a27-3369-4200-9860-13def3c7dcce tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:43.725007 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-2b6d2a27-3369-4200-9860-13def3c7dcce tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:43.731338 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2b6d2a27-3369-4200-9860-13def3c7dcce tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:43.731813 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2b6d2a27-3369-4200-9860-13def3c7dcce tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:43.732243 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2b6d2a27-3369-4200-9860-13def3c7dcce tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:43.732956 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2b6d2a27-3369-4200-9860-13def3c7dcce tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:43.733405 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2b6d2a27-3369-4200-9860-13def3c7dcce tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:43.733823 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2b6d2a27-3369-4200-9860-13def3c7dcce tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:43.861545 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-2b6d2a27-3369-4200-9860-13def3c7dcce tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:43.869757 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-2b6d2a27-3369-4200-9860-13def3c7dcce tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a" status: 200 len: 1367 microversion: 2.1 time: 0.149297 Oct 18 11:44:43.870331 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 303/587] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:43 2022] GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:44.892704 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-4e3ede1f-cd3d-453e-b8f5-6526edb43ce4 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:44.893452 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-4e3ede1f-cd3d-453e-b8f5-6526edb43ce4 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:44.899760 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4e3ede1f-cd3d-453e-b8f5-6526edb43ce4 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:44.900243 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4e3ede1f-cd3d-453e-b8f5-6526edb43ce4 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:44.900671 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4e3ede1f-cd3d-453e-b8f5-6526edb43ce4 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:44.901385 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4e3ede1f-cd3d-453e-b8f5-6526edb43ce4 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:44.902385 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4e3ede1f-cd3d-453e-b8f5-6526edb43ce4 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:44.902385 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4e3ede1f-cd3d-453e-b8f5-6526edb43ce4 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:45.044740 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-4e3ede1f-cd3d-453e-b8f5-6526edb43ce4 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:45.052723 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-4e3ede1f-cd3d-453e-b8f5-6526edb43ce4 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a" status: 200 len: 1367 microversion: 2.1 time: 0.164674 Oct 18 11:44:45.053321 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 285/588] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:44 2022] GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:44:46.075454 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-7763e0cb-2033-4d84-aef1-90c5f2a497d8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:46.076054 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-7763e0cb-2033-4d84-aef1-90c5f2a497d8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:46.082519 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7763e0cb-2033-4d84-aef1-90c5f2a497d8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:46.082988 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7763e0cb-2033-4d84-aef1-90c5f2a497d8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:46.084379 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7763e0cb-2033-4d84-aef1-90c5f2a497d8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:46.085084 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7763e0cb-2033-4d84-aef1-90c5f2a497d8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:46.085529 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7763e0cb-2033-4d84-aef1-90c5f2a497d8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:46.085942 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7763e0cb-2033-4d84-aef1-90c5f2a497d8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:46.217537 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-7763e0cb-2033-4d84-aef1-90c5f2a497d8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:46.225259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-7763e0cb-2033-4d84-aef1-90c5f2a497d8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a" status: 200 len: 1555 microversion: 2.1 time: 0.153563 Oct 18 11:44:46.225836 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 304/589] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:46 2022] GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:46.248124 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-e56d779d-9c23-4a8e-af27-a83fd99a78a3 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:46.248642 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-e56d779d-9c23-4a8e-af27-a83fd99a78a3 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:46.254901 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e56d779d-9c23-4a8e-af27-a83fd99a78a3 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:46.255990 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e56d779d-9c23-4a8e-af27-a83fd99a78a3 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:46.256418 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e56d779d-9c23-4a8e-af27-a83fd99a78a3 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:46.257125 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e56d779d-9c23-4a8e-af27-a83fd99a78a3 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:46.257571 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e56d779d-9c23-4a8e-af27-a83fd99a78a3 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:46.257987 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e56d779d-9c23-4a8e-af27-a83fd99a78a3 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:46.337625 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-e56d779d-9c23-4a8e-af27-a83fd99a78a3 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093318 Oct 18 11:44:46.338213 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 286/590] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Oct 18 11:44:46 2022] GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:44:47.488430 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-3f1526e8-8b6b-481f-a647-611cdd61a634 req-70e9cb73-9f81-49ed-b388-62215258251b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a", "tag": "57038a22-7ba2-4f5b-9e92-8aaac3f8c774"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:44:47.498538 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-3f1526e8-8b6b-481f-a647-611cdd61a634 req-70e9cb73-9f81-49ed-b388-62215258251b service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:47.499114 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-3f1526e8-8b6b-481f-a647-611cdd61a634 req-70e9cb73-9f81-49ed-b388-62215258251b service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:47.499633 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-3f1526e8-8b6b-481f-a647-611cdd61a634 req-70e9cb73-9f81-49ed-b388-62215258251b service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:47.513073 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-3f1526e8-8b6b-481f-a647-611cdd61a634 req-70e9cb73-9f81-49ed-b388-62215258251b service nova] Creating event network-changed:57038a22-7ba2-4f5b-9e92-8aaac3f8c774 for instance 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a on hv-cinder-81558 Oct 18 11:44:47.518227 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-3f1526e8-8b6b-481f-a647-611cdd61a634 req-70e9cb73-9f81-49ed-b388-62215258251b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033573 Oct 18 11:44:47.518852 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 305/591] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:44:53.520889 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-ea3b5784-9992-49ca-bc1e-ea788708ccea tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:53.523088 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-ea3b5784-9992-49ca-bc1e-ea788708ccea tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:53.529108 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ea3b5784-9992-49ca-bc1e-ea788708ccea tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:53.529591 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ea3b5784-9992-49ca-bc1e-ea788708ccea tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:53.530022 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ea3b5784-9992-49ca-bc1e-ea788708ccea tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:53.530702 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ea3b5784-9992-49ca-bc1e-ea788708ccea tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:53.531177 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ea3b5784-9992-49ca-bc1e-ea788708ccea tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:53.531600 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ea3b5784-9992-49ca-bc1e-ea788708ccea tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:53.561047 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-ea3b5784-9992-49ca-bc1e-ea788708ccea tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044742 Oct 18 11:44:53.561605 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 287/592] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Oct 18 11:44:53 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 11:44:53.628326 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-c843f0a8-19f4-4872-aa72-ba2c10863510 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:53.628911 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-c843f0a8-19f4-4872-aa72-ba2c10863510 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:53.634970 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c843f0a8-19f4-4872-aa72-ba2c10863510 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:53.635439 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c843f0a8-19f4-4872-aa72-ba2c10863510 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:53.635862 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c843f0a8-19f4-4872-aa72-ba2c10863510 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:53.636828 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c843f0a8-19f4-4872-aa72-ba2c10863510 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:53.637291 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c843f0a8-19f4-4872-aa72-ba2c10863510 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:53.637704 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c843f0a8-19f4-4872-aa72-ba2c10863510 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:53.662864 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-c843f0a8-19f4-4872-aa72-ba2c10863510 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Going to try to terminate instance {{(pid=125485) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 11:44:53.739851 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-c843f0a8-19f4-4872-aa72-ba2c10863510 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "DELETE /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 204 len: 0 microversion: 2.1 time: 0.115956 Oct 18 11:44:53.740445 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 306/593] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Oct 18 11:44:53 2022] DELETE /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 11:44:53.748678 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-bebe4348-d9f5-49e7-8ea3-8de1c480a5ba tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:53.749336 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-bebe4348-d9f5-49e7-8ea3-8de1c480a5ba tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:53.755234 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-bebe4348-d9f5-49e7-8ea3-8de1c480a5ba tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:53.755727 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-bebe4348-d9f5-49e7-8ea3-8de1c480a5ba tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:53.756164 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-bebe4348-d9f5-49e7-8ea3-8de1c480a5ba tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:53.756864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-bebe4348-d9f5-49e7-8ea3-8de1c480a5ba tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:53.757351 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-bebe4348-d9f5-49e7-8ea3-8de1c480a5ba tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:53.757775 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-bebe4348-d9f5-49e7-8ea3-8de1c480a5ba tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:53.887068 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-bebe4348-d9f5-49e7-8ea3-8de1c480a5ba tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:53.894720 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-bebe4348-d9f5-49e7-8ea3-8de1c480a5ba tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1672 microversion: 2.1 time: 0.149899 Oct 18 11:44:53.895278 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 288/594] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:53 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:54.919037 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-52bd1de3-f80c-48bd-ada9-b3bf3d198d96 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:54.919805 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-52bd1de3-f80c-48bd-ada9-b3bf3d198d96 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:54.926254 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-52bd1de3-f80c-48bd-ada9-b3bf3d198d96 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:54.926730 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-52bd1de3-f80c-48bd-ada9-b3bf3d198d96 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:54.927785 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-52bd1de3-f80c-48bd-ada9-b3bf3d198d96 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:54.928478 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-52bd1de3-f80c-48bd-ada9-b3bf3d198d96 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:54.928955 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-52bd1de3-f80c-48bd-ada9-b3bf3d198d96 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:54.929374 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-52bd1de3-f80c-48bd-ada9-b3bf3d198d96 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:55.057623 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-52bd1de3-f80c-48bd-ada9-b3bf3d198d96 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:55.065299 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-52bd1de3-f80c-48bd-ada9-b3bf3d198d96 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1672 microversion: 2.1 time: 0.150895 Oct 18 11:44:55.065865 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 307/595] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:54 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:56.088434 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-94d0a488-b5bf-45f2-9ca8-8ef16ec87f12 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:56.089136 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-94d0a488-b5bf-45f2-9ca8-8ef16ec87f12 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:56.095638 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-94d0a488-b5bf-45f2-9ca8-8ef16ec87f12 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:56.096122 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-94d0a488-b5bf-45f2-9ca8-8ef16ec87f12 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:56.096542 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-94d0a488-b5bf-45f2-9ca8-8ef16ec87f12 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:56.097262 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-94d0a488-b5bf-45f2-9ca8-8ef16ec87f12 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:56.097711 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-94d0a488-b5bf-45f2-9ca8-8ef16ec87f12 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:56.098132 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-94d0a488-b5bf-45f2-9ca8-8ef16ec87f12 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:56.323868 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-94d0a488-b5bf-45f2-9ca8-8ef16ec87f12 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:56.331485 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-94d0a488-b5bf-45f2-9ca8-8ef16ec87f12 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1672 microversion: 2.1 time: 0.247146 Oct 18 11:44:56.332048 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 289/596] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:56 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1672 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:56.906875 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-8b451892-ff43-4015-acda-cd108c926734 req-52955924-e233-4df0-8784-3192e77ecaa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96c06c00-7190-4ae9-a194-2d8f6123a781", "name": "network-vif-deleted", "tag": "d593caa5-bbcf-4c0d-8fdd-619edf5a1057"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:44:56.917320 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-8b451892-ff43-4015-acda-cd108c926734 req-52955924-e233-4df0-8784-3192e77ecaa3 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:56.917772 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-8b451892-ff43-4015-acda-cd108c926734 req-52955924-e233-4df0-8784-3192e77ecaa3 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:56.918292 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-8b451892-ff43-4015-acda-cd108c926734 req-52955924-e233-4df0-8784-3192e77ecaa3 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:56.931218 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-8b451892-ff43-4015-acda-cd108c926734 req-52955924-e233-4df0-8784-3192e77ecaa3 service nova] Creating event network-vif-deleted:d593caa5-bbcf-4c0d-8fdd-619edf5a1057 for instance 96c06c00-7190-4ae9-a194-2d8f6123a781 on hv-cinder-81558 Oct 18 11:44:56.936544 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-8b451892-ff43-4015-acda-cd108c926734 req-52955924-e233-4df0-8784-3192e77ecaa3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033278 Oct 18 11:44:56.937801 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 308/597] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:44:57.355115 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-a5674376-ccbc-4939-ae3b-4323c8a8b168 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:57.355754 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-a5674376-ccbc-4939-ae3b-4323c8a8b168 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:57.362412 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a5674376-ccbc-4939-ae3b-4323c8a8b168 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:57.362888 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a5674376-ccbc-4939-ae3b-4323c8a8b168 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:57.363315 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a5674376-ccbc-4939-ae3b-4323c8a8b168 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:57.364002 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a5674376-ccbc-4939-ae3b-4323c8a8b168 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:57.364447 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a5674376-ccbc-4939-ae3b-4323c8a8b168 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:57.365461 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a5674376-ccbc-4939-ae3b-4323c8a8b168 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:57.397505 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a5674376-ccbc-4939-ae3b-4323c8a8b168 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:57.398084 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a5674376-ccbc-4939-ae3b-4323c8a8b168 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:57.398518 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a5674376-ccbc-4939-ae3b-4323c8a8b168 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:57.398955 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.objects.instance [None req-a5674376-ccbc-4939-ae3b-4323c8a8b168 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lazy-loading 'fault' on Instance uuid 96c06c00-7190-4ae9-a194-2d8f6123a781 {{(pid=125486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:44:57.443913 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-a5674376-ccbc-4939-ae3b-4323c8a8b168 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:44:57.452227 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-a5674376-ccbc-4939-ae3b-4323c8a8b168 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 200 len: 1327 microversion: 2.1 time: 0.100825 Oct 18 11:44:57.452810 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 290/598] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:57 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 1327 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:44:58.476656 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-b634f7e7-7460-4e80-a435-03a20d961023 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:58.477295 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-b634f7e7-7460-4e80-a435-03a20d961023 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:58.483367 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b634f7e7-7460-4e80-a435-03a20d961023 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:58.483839 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b634f7e7-7460-4e80-a435-03a20d961023 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:58.484267 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b634f7e7-7460-4e80-a435-03a20d961023 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:58.484976 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b634f7e7-7460-4e80-a435-03a20d961023 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:58.485422 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b634f7e7-7460-4e80-a435-03a20d961023 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:58.485834 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b634f7e7-7460-4e80-a435-03a20d961023 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:58.498644 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.wsgi [None req-b634f7e7-7460-4e80-a435-03a20d961023 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] HTTP exception thrown: Instance 96c06c00-7190-4ae9-a194-2d8f6123a781 could not be found. Oct 18 11:44:58.500259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-b634f7e7-7460-4e80-a435-03a20d961023 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Request method failure captured: Oct 18 11:44:58.500259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 HTTP/1.1 Oct 18 11:44:58.500259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:44:58.500259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:44:58.500259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:44:58.500259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 0 Oct 18 11:44:58.500259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:44:58.500259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:44:58.500259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:44:58.500259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:44:58.500259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpCrIy4GzQCjUy1CRhpWWp69iHHeGG1rwC3C0zuL3UPG3bIyKSCl6QRRPIuq8bZKkzY01EOqQmpc6SwgfWY80EaHeb7Ws4uWGbs24InFMZsFWR6Z_kxuVXDWHOl5BL3N-FmXhI9g4oBLtomfNoIxMN_DNXOgm2KUAyIALP9GvKTS8Co Oct 18 11:44:58.500259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:44:58.500259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:44:58.500259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:44:58.500259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:44:58.500259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:44:58.500259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:44:58.500259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: ffc96760658d4e19af26d6cf22e94172 Oct 18 11:44:58.500259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-AttachVolumeTestJSON-1223120040 Oct 18 11:44:58.500259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:44:58.500259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:44:58.501898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ffc96760658d4e19af26d6cf22e94172"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ffc96760658d4e19af26d6cf22e94172"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ffc96760658d4e19af26d6cf22e94172"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ffc96760658d4e19af26d6cf22e94172"}]}] Oct 18 11:44:58.501898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-AttachVolumeTestJSON-1223120040 Oct 18 11:44:58.501898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: ffc96760658d4e19af26d6cf22e94172 Oct 18 11:44:58.501898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1223120040 Oct 18 11:44:58.501898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-AttachVolumeTestJSON-1223120040-project Oct 18 11:44:58.501898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:44:58.501898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:44:58.501898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: bddd3d2bb8f647f2ba616141eb16622e Oct 18 11:44:58.501898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-AttachVolumeTestJSON-1223120040-project Oct 18 11:44:58.501898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: > Oct 18 11:44:58.501898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Instance 96c06c00-7190-4ae9-a194-2d8f6123a781 could not be found. Oct 18 11:44:58.501898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'id': '96c06c00-7190-4ae9-a194-2d8f6123a781'} Oct 18 11:44:58.502849 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:44:58.502849 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:44:58.502849 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:44:58.502849 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:44:58.502849 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:44:58.502849 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:44:58.502849 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:44:58.502849 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:44:58.502849 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:44:58.502849 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:44:58.502849 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96c06c00-7190-4ae9-a194-2d8f6123a781 could not be found. Oct 18 11:44:58.502849 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:44:58.502849 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:44:58.502849 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:44:58.502849 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:44:58.502849 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:44:58.502849 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:44:58.502849 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:44:58.502849 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:44:58.502849 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:44:58.504322 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:44:58.504322 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 11:44:58.504322 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 11:44:58.504322 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:44:58.504322 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:44:58.504322 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:44:58.504322 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:44:58.504322 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96c06c00-7190-4ae9-a194-2d8f6123a781 could not be found. Oct 18 11:44:58.504322 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:44:58.504322 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:44:58.504322 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:44:58.504322 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:44:58.504322 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:44:58.504322 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:44:58.504322 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:44:58.504322 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:44:58.504322 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96c06c00-7190-4ae9-a194-2d8f6123a781 could not be found. Oct 18 11:44:58.504322 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:44:58.506176 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-b634f7e7-7460-4e80-a435-03a20d961023 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Returning 404 to user: Instance 96c06c00-7190-4ae9-a194-2d8f6123a781 could not be found. {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:44:58.506176 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-b634f7e7-7460-4e80-a435-03a20d961023 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 404 len: 111 microversion: 2.1 time: 0.029792 Oct 18 11:44:58.506176 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 309/599] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:44:58 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:44:58.510851 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-860c6404-d168-4753-a1b6-ea0801a62f9a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '.version_select at 0x7f4be03c4550>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:58.515355 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR oslo.messaging._drivers.impl_rabbit [None req-860c6404-d168-4753-a1b6-ea0801a62f9a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [ab93f3c2-fbcc-4067-9d29-535c7af8c5ba] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 11:44:58.704333 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-f7dc2470-0b28-4449-ac45-998e1cff6643 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:58.704821 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-f7dc2470-0b28-4449-ac45-998e1cff6643 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:58.711877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f7dc2470-0b28-4449-ac45-998e1cff6643 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:58.712348 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f7dc2470-0b28-4449-ac45-998e1cff6643 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:58.712773 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f7dc2470-0b28-4449-ac45-998e1cff6643 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:58.713475 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f7dc2470-0b28-4449-ac45-998e1cff6643 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:58.713939 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f7dc2470-0b28-4449-ac45-998e1cff6643 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:58.714354 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f7dc2470-0b28-4449-ac45-998e1cff6643 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:58.743596 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-f7dc2470-0b28-4449-ac45-998e1cff6643 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d/os-volume_attachments/53d2f173-e724-4c32-9a52-c211d400717d" status: 200 len: 194 microversion: 2.20 time: 0.043211 Oct 18 11:44:58.744082 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 310/600] 10.222.0.17 () {60 vars in 1454 bytes} [Tue Oct 18 11:44:58 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d/os-volume_attachments/53d2f173-e724-4c32-9a52-c211d400717d => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 11:44:58.811132 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-85a4ebf0-da89-4094-82d7-2fe880d498ad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:58.811614 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-85a4ebf0-da89-4094-82d7-2fe880d498ad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:58.817717 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-85a4ebf0-da89-4094-82d7-2fe880d498ad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:58.818190 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-85a4ebf0-da89-4094-82d7-2fe880d498ad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:58.818617 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-85a4ebf0-da89-4094-82d7-2fe880d498ad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:58.819287 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-85a4ebf0-da89-4094-82d7-2fe880d498ad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:58.819732 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-85a4ebf0-da89-4094-82d7-2fe880d498ad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:58.820139 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-85a4ebf0-da89-4094-82d7-2fe880d498ad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:58.900377 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.objects.instance [None req-85a4ebf0-da89-4094-82d7-2fe880d498ad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lazy-loading 'services' on Instance uuid a2b9dfa2-7553-47cd-8274-6a0004bac79d {{(pid=125485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:44:58.970649 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-85a4ebf0-da89-4094-82d7-2fe880d498ad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d/os-volume_attachments/53d2f173-e724-4c32-9a52-c211d400717d" status: 202 len: 0 microversion: 2.20 time: 0.163349 Oct 18 11:44:58.971428 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 311/601] 10.222.0.17 () {60 vars in 1457 bytes} [Tue Oct 18 11:44:58 2022] DELETE /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d/os-volume_attachments/53d2f173-e724-4c32-9a52-c211d400717d => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 18 11:44:58.980962 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-23ee4706-cb76-4db3-af1f-0695071e359a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:44:58.983219 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-23ee4706-cb76-4db3-af1f-0695071e359a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:44:58.989436 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-23ee4706-cb76-4db3-af1f-0695071e359a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:58.989916 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-23ee4706-cb76-4db3-af1f-0695071e359a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:58.990358 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-23ee4706-cb76-4db3-af1f-0695071e359a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:58.991045 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-23ee4706-cb76-4db3-af1f-0695071e359a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:44:58.991489 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-23ee4706-cb76-4db3-af1f-0695071e359a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:44:58.991906 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-23ee4706-cb76-4db3-af1f-0695071e359a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:44:59.009956 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:44:59.024991 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-23ee4706-cb76-4db3-af1f-0695071e359a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048106 Oct 18 11:44:59.025553 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 312/602] 10.222.0.17 () {60 vars in 1343 bytes} [Tue Oct 18 11:44:58 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 11:44:59.523790 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO oslo.messaging._drivers.impl_rabbit [None req-860c6404-d168-4753-a1b6-ea0801a62f9a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [ab93f3c2-fbcc-4067-9d29-535c7af8c5ba] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 42826. Oct 18 11:44:59.542770 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-860c6404-d168-4753-a1b6-ea0801a62f9a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-593272598" status: 202 len: 0 microversion: 2.1 time: 1.035634 Oct 18 11:44:59.543536 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 291/603] 10.222.0.17 () {58 vars in 1218 bytes} [Tue Oct 18 11:44:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-593272598 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 11:45:00.038741 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-436732e2-795d-4765-98a2-121018140f34 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:00.040947 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-436732e2-795d-4765-98a2-121018140f34 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:00.047691 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-436732e2-795d-4765-98a2-121018140f34 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:00.048206 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-436732e2-795d-4765-98a2-121018140f34 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:00.048629 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-436732e2-795d-4765-98a2-121018140f34 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:00.049361 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-436732e2-795d-4765-98a2-121018140f34 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:00.049810 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-436732e2-795d-4765-98a2-121018140f34 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:00.050229 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-436732e2-795d-4765-98a2-121018140f34 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:00.081883 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-436732e2-795d-4765-98a2-121018140f34 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047738 Oct 18 11:45:00.082639 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 313/604] 10.222.0.17 () {60 vars in 1343 bytes} [Tue Oct 18 11:45:00 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:00.149670 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-4e88e438-8b08-4610-9798-0862f52db55e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:00.150300 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-4e88e438-8b08-4610-9798-0862f52db55e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:00.156808 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4e88e438-8b08-4610-9798-0862f52db55e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:00.157219 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4e88e438-8b08-4610-9798-0862f52db55e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:00.164512 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4e88e438-8b08-4610-9798-0862f52db55e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:00.164512 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4e88e438-8b08-4610-9798-0862f52db55e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:00.164512 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4e88e438-8b08-4610-9798-0862f52db55e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:00.164512 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4e88e438-8b08-4610-9798-0862f52db55e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:00.177819 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-207db06b-53f6-4322-8fbb-da1a4c1b5b2a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Action: 'create', calling method: .version_select at 0x7f4be04001f0>, body: {"keypair": {"name": "tempest-keypair-1295372192", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhZlQJ3TuppYEgUN8cN5eyZAsoqfue+lmRCrNeikH/fMbB4rAqG31f+2/BIqb4lsSTO8OGFX5GE9yJnHdN4mFeR8Muia0EKAQGU4yZVGsVa8wjJEiQ/ekFDJj12SX+zuA=="}} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:45:00.193506 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.quota [None req-207db06b-53f6-4322-8fbb-da1a4c1b5b2a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Getting quotas for project ffc96760658d4e19af26d6cf22e94172. Resources: {'key_pairs'} {{(pid=125485) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:45:00.197337 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.quota [None req-207db06b-53f6-4322-8fbb-da1a4c1b5b2a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Getting quotas for user bddd3d2bb8f647f2ba616141eb16622e and project ffc96760658d4e19af26d6cf22e94172. Resources: {'key_pairs'} {{(pid=125485) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:45:00.198972 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-4e88e438-8b08-4610-9798-0862f52db55e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Going to try to terminate instance {{(pid=125486) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 11:45:00.220305 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-207db06b-53f6-4322-8fbb-da1a4c1b5b2a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046302 Oct 18 11:45:00.220920 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 314/605] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Oct 18 11:45:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:45:00.274383 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-4e88e438-8b08-4610-9798-0862f52db55e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 204 len: 0 microversion: 2.20 time: 0.128918 Oct 18 11:45:00.275100 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 292/606] 10.222.0.17 () {60 vars in 1280 bytes} [Tue Oct 18 11:45:00 2022] DELETE /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 11:45:00.284034 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-0c4d5e18-48b2-4f2d-b544-4aa2153fa481 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:00.285296 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-0c4d5e18-48b2-4f2d-b544-4aa2153fa481 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:00.291278 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0c4d5e18-48b2-4f2d-b544-4aa2153fa481 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:00.291754 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0c4d5e18-48b2-4f2d-b544-4aa2153fa481 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:00.292182 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0c4d5e18-48b2-4f2d-b544-4aa2153fa481 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:00.292911 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0c4d5e18-48b2-4f2d-b544-4aa2153fa481 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:00.293359 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0c4d5e18-48b2-4f2d-b544-4aa2153fa481 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:00.293775 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0c4d5e18-48b2-4f2d-b544-4aa2153fa481 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:00.439295 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-0c4d5e18-48b2-4f2d-b544-4aa2153fa481 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:00.448039 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-0c4d5e18-48b2-4f2d-b544-4aa2153fa481 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:00.449559 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-0c4d5e18-48b2-4f2d-b544-4aa2153fa481 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:00.450771 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-0c4d5e18-48b2-4f2d-b544-4aa2153fa481 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1722 microversion: 2.20 time: 0.170980 Oct 18 11:45:00.451329 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 315/607] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:45:00 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:45:01.476369 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-8f224e38-fc72-455e-beb7-60dd63d1b8cc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:01.477115 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-8f224e38-fc72-455e-beb7-60dd63d1b8cc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:01.483312 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8f224e38-fc72-455e-beb7-60dd63d1b8cc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:01.483785 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8f224e38-fc72-455e-beb7-60dd63d1b8cc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:01.484209 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8f224e38-fc72-455e-beb7-60dd63d1b8cc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:01.484904 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8f224e38-fc72-455e-beb7-60dd63d1b8cc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:01.485350 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8f224e38-fc72-455e-beb7-60dd63d1b8cc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:01.485764 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8f224e38-fc72-455e-beb7-60dd63d1b8cc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:01.495311 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-fd21c507-238d-457c-8c2a-e0bbda2bee65 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-479798384", "imageRef": "a4917b56-ebe0-409a-894a-469900c12b94", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e349e211-459b-40e0-9dfd-ac48079863f5"}], "security_groups": [{"name": "tempest-securitygroup--630217480"}], "key_name": "tempest-keypair-1295372192", "user_data": "}} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:45:01.504032 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:45:01.507072 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:45:01.604019 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.network.neutron [None req-fd21c507-238d-457c-8c2a-e0bbda2bee65 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] validate_networks() for [('e349e211-459b-40e0-9dfd-ac48079863f5', None, None, None, None, None)] {{(pid=125485) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 11:45:01.625189 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-8f224e38-fc72-455e-beb7-60dd63d1b8cc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:01.634619 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-8f224e38-fc72-455e-beb7-60dd63d1b8cc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:01.637247 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-8f224e38-fc72-455e-beb7-60dd63d1b8cc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:01.638489 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-8f224e38-fc72-455e-beb7-60dd63d1b8cc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1722 microversion: 2.20 time: 0.166312 Oct 18 11:45:01.639247 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 293/608] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:45:01 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:45:01.975146 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-fd21c507-238d-457c-8c2a-e0bbda2bee65 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Flavor limits 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 11:45:01.975553 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-fd21c507-238d-457c-8c2a-e0bbda2bee65 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Image limits 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 11:45:01.976039 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-fd21c507-238d-457c-8c2a-e0bbda2bee65 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Flavor pref 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 11:45:01.976431 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-fd21c507-238d-457c-8c2a-e0bbda2bee65 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Image pref 0:0:0 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 11:45:01.976866 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.virt.hardware [None req-fd21c507-238d-457c-8c2a-e0bbda2bee65 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 11:45:01.985499 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fd21c507-238d-457c-8c2a-e0bbda2bee65 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:01.985964 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fd21c507-238d-457c-8c2a-e0bbda2bee65 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:01.986390 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fd21c507-238d-457c-8c2a-e0bbda2bee65 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:01.987096 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fd21c507-238d-457c-8c2a-e0bbda2bee65 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:01.987541 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fd21c507-238d-457c-8c2a-e0bbda2bee65 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:01.987952 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fd21c507-238d-457c-8c2a-e0bbda2bee65 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:02.005603 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.quota [None req-fd21c507-238d-457c-8c2a-e0bbda2bee65 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Getting quotas for project ffc96760658d4e19af26d6cf22e94172. Resources: {'cores', 'instances', 'ram'} {{(pid=125485) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:45:02.009641 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.quota [None req-fd21c507-238d-457c-8c2a-e0bbda2bee65 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Getting quotas for user bddd3d2bb8f647f2ba616141eb16622e and project ffc96760658d4e19af26d6cf22e94172. Resources: {'cores', 'instances', 'ram'} {{(pid=125485) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:45:02.020969 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-fd21c507-238d-457c-8c2a-e0bbda2bee65 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Going to run 1 instances... {{(pid=125485) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 11:45:02.023261 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-fd21c507-238d-457c-8c2a-e0bbda2bee65 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4917b56-ebe0-409a-894a-469900c12b94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125485) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 11:45:02.072431 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-fd21c507-238d-457c-8c2a-e0bbda2bee65 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.581220 Oct 18 11:45:02.073339 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 316/609] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Oct 18 11:45:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 11:45:02.084518 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-c4cfffc1-8a97-415e-ab54-911254d76dcd tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:02.086015 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-c4cfffc1-8a97-415e-ab54-911254d76dcd tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:02.160868 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-c4cfffc1-8a97-415e-ab54-911254d76dcd tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:02.169108 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-c4cfffc1-8a97-415e-ab54-911254d76dcd tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488" status: 200 len: 1237 microversion: 2.1 time: 0.088552 Oct 18 11:45:02.180960 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 294/610] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:02 2022] GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488 => generated 1237 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:02.665519 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-933582f9-9466-4ae2-a37b-ccae8bb8842d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:02.666047 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-933582f9-9466-4ae2-a37b-ccae8bb8842d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:02.674914 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-933582f9-9466-4ae2-a37b-ccae8bb8842d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:02.675407 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-933582f9-9466-4ae2-a37b-ccae8bb8842d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:02.675846 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-933582f9-9466-4ae2-a37b-ccae8bb8842d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:02.676549 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-933582f9-9466-4ae2-a37b-ccae8bb8842d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:02.677105 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-933582f9-9466-4ae2-a37b-ccae8bb8842d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:02.677564 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-933582f9-9466-4ae2-a37b-ccae8bb8842d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:02.744353 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-933582f9-9466-4ae2-a37b-ccae8bb8842d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:02.755524 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-933582f9-9466-4ae2-a37b-ccae8bb8842d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:02.757042 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-933582f9-9466-4ae2-a37b-ccae8bb8842d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:02.758236 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-933582f9-9466-4ae2-a37b-ccae8bb8842d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1656 microversion: 2.20 time: 0.098543 Oct 18 11:45:02.758791 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 317/611] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:45:02 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1656 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:45:02.904209 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-d40aeab1-f461-4c68-87e6-49d111ec7405 req-10645f3a-5c93-4118-9d6a-2359c026903c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2b9dfa2-7553-47cd-8274-6a0004bac79d", "name": "network-vif-deleted", "tag": "03f3558a-e868-4501-8139-30b9edad14e0"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:45:02.915290 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-d40aeab1-f461-4c68-87e6-49d111ec7405 req-10645f3a-5c93-4118-9d6a-2359c026903c service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:02.915831 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-d40aeab1-f461-4c68-87e6-49d111ec7405 req-10645f3a-5c93-4118-9d6a-2359c026903c service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:02.916427 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-d40aeab1-f461-4c68-87e6-49d111ec7405 req-10645f3a-5c93-4118-9d6a-2359c026903c service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:02.928707 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-d40aeab1-f461-4c68-87e6-49d111ec7405 req-10645f3a-5c93-4118-9d6a-2359c026903c service nova] Creating event network-vif-deleted:03f3558a-e868-4501-8139-30b9edad14e0 for instance a2b9dfa2-7553-47cd-8274-6a0004bac79d on hv-cinder-81558 Oct 18 11:45:02.935054 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-d40aeab1-f461-4c68-87e6-49d111ec7405 req-10645f3a-5c93-4118-9d6a-2359c026903c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034451 Oct 18 11:45:02.936158 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 295/612] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:45:03.195306 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ec76ec87-61d1-4c08-9271-d8ba226aeebb tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:03.196157 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-ec76ec87-61d1-4c08-9271-d8ba226aeebb tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:03.205584 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ec76ec87-61d1-4c08-9271-d8ba226aeebb tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:03.206038 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ec76ec87-61d1-4c08-9271-d8ba226aeebb tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:03.206468 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ec76ec87-61d1-4c08-9271-d8ba226aeebb tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:03.207302 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ec76ec87-61d1-4c08-9271-d8ba226aeebb tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:03.208725 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ec76ec87-61d1-4c08-9271-d8ba226aeebb tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:03.209373 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ec76ec87-61d1-4c08-9271-d8ba226aeebb tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:03.271558 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-ec76ec87-61d1-4c08-9271-d8ba226aeebb tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:03.279077 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-ec76ec87-61d1-4c08-9271-d8ba226aeebb tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488" status: 200 len: 1289 microversion: 2.1 time: 0.090101 Oct 18 11:45:03.279634 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 318/613] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:03 2022] GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488 => generated 1289 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:03.789250 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-fe172935-1f2c-4071-9b29-ea5f1613b84c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:03.790163 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-fe172935-1f2c-4071-9b29-ea5f1613b84c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:03.799636 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fe172935-1f2c-4071-9b29-ea5f1613b84c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:03.801476 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fe172935-1f2c-4071-9b29-ea5f1613b84c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:03.802804 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fe172935-1f2c-4071-9b29-ea5f1613b84c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:03.803786 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fe172935-1f2c-4071-9b29-ea5f1613b84c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:03.804401 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fe172935-1f2c-4071-9b29-ea5f1613b84c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:03.805018 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fe172935-1f2c-4071-9b29-ea5f1613b84c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:03.844797 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fe172935-1f2c-4071-9b29-ea5f1613b84c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:03.845420 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fe172935-1f2c-4071-9b29-ea5f1613b84c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:03.845952 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fe172935-1f2c-4071-9b29-ea5f1613b84c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:03.846480 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.objects.instance [None req-fe172935-1f2c-4071-9b29-ea5f1613b84c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lazy-loading 'fault' on Instance uuid a2b9dfa2-7553-47cd-8274-6a0004bac79d {{(pid=125486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:45:04.158242 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-fe172935-1f2c-4071-9b29-ea5f1613b84c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:04.167490 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-fe172935-1f2c-4071-9b29-ea5f1613b84c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:04.168955 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-fe172935-1f2c-4071-9b29-ea5f1613b84c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:04.170135 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-fe172935-1f2c-4071-9b29-ea5f1613b84c tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 200 len: 1372 microversion: 2.20 time: 0.389960 Oct 18 11:45:04.170688 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 296/614] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:45:03 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 1372 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:45:04.301939 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ffe6a052-9e0d-42bd-b9ab-c3f639d2ccc2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:04.302641 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-ffe6a052-9e0d-42bd-b9ab-c3f639d2ccc2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:04.311407 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ffe6a052-9e0d-42bd-b9ab-c3f639d2ccc2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:04.312053 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ffe6a052-9e0d-42bd-b9ab-c3f639d2ccc2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:04.312338 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ffe6a052-9e0d-42bd-b9ab-c3f639d2ccc2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:04.313072 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ffe6a052-9e0d-42bd-b9ab-c3f639d2ccc2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:04.314336 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ffe6a052-9e0d-42bd-b9ab-c3f639d2ccc2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:04.314903 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ffe6a052-9e0d-42bd-b9ab-c3f639d2ccc2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:04.386094 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-ffe6a052-9e0d-42bd-b9ab-c3f639d2ccc2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:04.393725 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-ffe6a052-9e0d-42bd-b9ab-c3f639d2ccc2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488" status: 200 len: 1295 microversion: 2.1 time: 0.095770 Oct 18 11:45:04.394293 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 319/615] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:04 2022] GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488 => generated 1295 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:05.196409 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-c514a911-f531-422c-8445-3640cccb41e5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:05.197051 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-c514a911-f531-422c-8445-3640cccb41e5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:05.202879 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c514a911-f531-422c-8445-3640cccb41e5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:05.203357 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c514a911-f531-422c-8445-3640cccb41e5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:05.203785 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c514a911-f531-422c-8445-3640cccb41e5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:05.204467 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c514a911-f531-422c-8445-3640cccb41e5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:05.204934 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c514a911-f531-422c-8445-3640cccb41e5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:05.205364 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c514a911-f531-422c-8445-3640cccb41e5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:05.220102 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.wsgi [None req-c514a911-f531-422c-8445-3640cccb41e5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] HTTP exception thrown: Instance a2b9dfa2-7553-47cd-8274-6a0004bac79d could not be found. Oct 18 11:45:05.221776 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-c514a911-f531-422c-8445-3640cccb41e5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Request method failure captured: Oct 18 11:45:05.221776 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: request: GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d HTTP/1.1 Oct 18 11:45:05.221776 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept: application/json Oct 18 11:45:05.221776 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept-Encoding: identity Oct 18 11:45:05.221776 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Connection: close Oct 18 11:45:05.221776 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Length: 0 Oct 18 11:45:05.221776 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Type: application/json Oct 18 11:45:05.221776 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Host: 10.222.0.17 Oct 18 11:45:05.221776 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Openstack-System-Scope: None Oct 18 11:45:05.221776 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: User-Agent: python-urllib3/1.26.12 Oct 18 11:45:05.221776 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Auth-Token: gAAAAABjTpD-afc9lTwVyWNoeKrcwdibmsDnK1_JwD8xfNCwibUypcKZiq4F7at3MbhFhuB-njWr1w-PsQZwMGvpu9u0JY1lRX6PUymcjGKLuOhPiqjkMgGnuUSCFUA9Mc_ddtpasTB8QaQwwyC6v1sjVOexo45w2k7uG6XZDh0PXxHC7pvCUL0 Oct 18 11:45:05.221776 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Id: None Oct 18 11:45:05.221776 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Name: None Oct 18 11:45:05.221776 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Identity-Status: Confirmed Oct 18 11:45:05.221776 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Is-Admin-Project: True Oct 18 11:45:05.221776 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Openstack-Nova-Api-Version: 2.20 Oct 18 11:45:05.221776 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Id: default Oct 18 11:45:05.221776 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Name: Default Oct 18 11:45:05.221776 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Id: c84cfe68e5db4b2dba60443b48d23097 Oct 18 11:45:05.221776 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1946372457 Oct 18 11:45:05.221776 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Role: reader,member Oct 18 11:45:05.221776 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Roles: reader,member Oct 18 11:45:05.223246 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c84cfe68e5db4b2dba60443b48d23097"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c84cfe68e5db4b2dba60443b48d23097"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c84cfe68e5db4b2dba60443b48d23097"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c84cfe68e5db4b2dba60443b48d23097"}]}] Oct 18 11:45:05.223246 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1946372457 Oct 18 11:45:05.223246 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Id: c84cfe68e5db4b2dba60443b48d23097 Oct 18 11:45:05.223246 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1946372457 Oct 18 11:45:05.223246 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User: tempest-AttachVolumeShelveTestJSON-1946372457-project Oct 18 11:45:05.223246 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Id: default Oct 18 11:45:05.223246 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Name: Default Oct 18 11:45:05.223246 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Id: 72d748ebce2742058757304095d1a641 Oct 18 11:45:05.223246 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1946372457-project Oct 18 11:45:05.223246 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: method: > Oct 18 11:45:05.223246 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: exception: Instance a2b9dfa2-7553-47cd-8274-6a0004bac79d could not be found. Oct 18 11:45:05.223246 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: action_args: {'id': 'a2b9dfa2-7553-47cd-8274-6a0004bac79d'} Oct 18 11:45:05.224067 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:45:05.224067 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:45:05.224067 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:45:05.224067 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:45:05.224067 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:45:05.224067 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:45:05.224067 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:45:05.224067 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:45:05.224067 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:45:05.224067 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:45:05.224067 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2b9dfa2-7553-47cd-8274-6a0004bac79d could not be found. Oct 18 11:45:05.224067 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:45:05.224067 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:45:05.224067 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:45:05.224067 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:45:05.224067 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:45:05.224067 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:45:05.224067 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:45:05.224067 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:45:05.224067 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:45:05.225335 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:45:05.225335 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 11:45:05.225335 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 11:45:05.225335 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:45:05.225335 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:45:05.225335 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:45:05.225335 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:45:05.225335 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2b9dfa2-7553-47cd-8274-6a0004bac79d could not be found. Oct 18 11:45:05.225335 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:45:05.225335 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:45:05.225335 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:45:05.225335 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:45:05.225335 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:45:05.225335 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:45:05.225335 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:45:05.225335 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:45:05.225335 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2b9dfa2-7553-47cd-8274-6a0004bac79d could not be found. Oct 18 11:45:05.225335 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:45:05.226578 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-c514a911-f531-422c-8445-3640cccb41e5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Returning 404 to user: Instance a2b9dfa2-7553-47cd-8274-6a0004bac79d could not be found. {{(pid=125486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:45:05.226578 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-c514a911-f531-422c-8445-3640cccb41e5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 404 len: 111 microversion: 2.20 time: 0.031563 Oct 18 11:45:05.226578 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 297/616] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:45:05 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 11:45:05.234084 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-7449dc78-db73-49f5-b78c-cde13bffc003 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '.version_select at 0x7f4bdbf15c10>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:05.253470 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-7449dc78-db73-49f5-b78c-cde13bffc003 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1381857059" status: 204 len: 0 microversion: 2.20 time: 0.023081 Oct 18 11:45:05.254102 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 320/617] 10.222.0.17 () {60 vars in 1262 bytes} [Tue Oct 18 11:45:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1381857059 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 11:45:05.336380 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-74df9c33-edf0-4f7e-ab35-cf1f3cb6e66a req-e7d8eb0f-f923-4e86-afeb-bee2979823ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad4d6e0a-d6d8-42b6-a448-621a32b1c488", "tag": "c37ea581-1038-42d3-af45-0da5fa44ccbd"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:45:05.356551 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-74df9c33-edf0-4f7e-ab35-cf1f3cb6e66a req-e7d8eb0f-f923-4e86-afeb-bee2979823ac service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:05.357272 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-74df9c33-edf0-4f7e-ab35-cf1f3cb6e66a req-e7d8eb0f-f923-4e86-afeb-bee2979823ac service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:05.358024 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-74df9c33-edf0-4f7e-ab35-cf1f3cb6e66a req-e7d8eb0f-f923-4e86-afeb-bee2979823ac service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:05.380364 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-74df9c33-edf0-4f7e-ab35-cf1f3cb6e66a req-e7d8eb0f-f923-4e86-afeb-bee2979823ac service nova] Creating event network-changed:c37ea581-1038-42d3-af45-0da5fa44ccbd for instance ad4d6e0a-d6d8-42b6-a448-621a32b1c488 on hv-cinder-81558 Oct 18 11:45:05.388866 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-74df9c33-edf0-4f7e-ab35-cf1f3cb6e66a req-e7d8eb0f-f923-4e86-afeb-bee2979823ac service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061060 Oct 18 11:45:05.390002 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 298/618] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:45:05.419151 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-08d31e29-887e-4c16-aa71-c479a1cf4211 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:05.419865 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-08d31e29-887e-4c16-aa71-c479a1cf4211 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:05.428260 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-08d31e29-887e-4c16-aa71-c479a1cf4211 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:05.431687 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-08d31e29-887e-4c16-aa71-c479a1cf4211 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:05.432075 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-08d31e29-887e-4c16-aa71-c479a1cf4211 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:05.432788 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-08d31e29-887e-4c16-aa71-c479a1cf4211 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:05.433289 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-08d31e29-887e-4c16-aa71-c479a1cf4211 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:05.433723 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-08d31e29-887e-4c16-aa71-c479a1cf4211 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:05.693599 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-08d31e29-887e-4c16-aa71-c479a1cf4211 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:05.701345 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-08d31e29-887e-4c16-aa71-c479a1cf4211 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488" status: 200 len: 1362 microversion: 2.1 time: 0.287704 Oct 18 11:45:05.701915 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 321/619] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:05 2022] GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488 => generated 1362 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:06.000806 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-f2165242-25eb-4119-9d6e-a84e8ae7cfec tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Action: 'create', calling method: .version_select at 0x7f4bdbdde4c0>, body: {"keypair": {"name": "tempest-keypair-581564285", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENGBJt/5GiSLuOrTdHXRPgjERPB0SBEhDRcQjWoVyV5xirrTlhsf6ZpKp6uuiiKoXZ1zGFVoCJfFzQY50tuTkRpeI5KY0uxfcuFzmsPTfTA8Fpr/A29pkCmun/OzRxA3g=="}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:45:06.016387 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-f2165242-25eb-4119-9d6e-a84e8ae7cfec tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Getting quotas for project c84cfe68e5db4b2dba60443b48d23097. Resources: {'key_pairs'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:45:06.020203 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-f2165242-25eb-4119-9d6e-a84e8ae7cfec tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Getting quotas for user 72d748ebce2742058757304095d1a641 and project c84cfe68e5db4b2dba60443b48d23097. Resources: {'key_pairs'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:45:06.042543 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-f2165242-25eb-4119-9d6e-a84e8ae7cfec tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.046090 Oct 18 11:45:06.043135 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 299/620] 10.222.0.17 () {62 vars in 1200 bytes} [Tue Oct 18 11:45:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 18 11:45:06.724949 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-c98ca517-6fc1-44d2-b459-8dfaf53e0c3e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:06.725477 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-c98ca517-6fc1-44d2-b459-8dfaf53e0c3e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:06.732525 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c98ca517-6fc1-44d2-b459-8dfaf53e0c3e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:06.733039 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c98ca517-6fc1-44d2-b459-8dfaf53e0c3e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:06.733475 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c98ca517-6fc1-44d2-b459-8dfaf53e0c3e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:06.734208 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c98ca517-6fc1-44d2-b459-8dfaf53e0c3e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:06.734693 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c98ca517-6fc1-44d2-b459-8dfaf53e0c3e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:06.735156 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c98ca517-6fc1-44d2-b459-8dfaf53e0c3e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:06.954476 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-c98ca517-6fc1-44d2-b459-8dfaf53e0c3e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:06.967836 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-c98ca517-6fc1-44d2-b459-8dfaf53e0c3e tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488" status: 200 len: 1362 microversion: 2.1 time: 0.246778 Oct 18 11:45:06.969022 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 322/621] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:06 2022] GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488 => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:07.417408 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-13250029-5cf7-4dcb-bbad-980c5ddfe275 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-10970845", "imageRef": "a4917b56-ebe0-409a-894a-469900c12b94", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fea5d1fc-e591-4b70-83db-447fa0d3a485"}], "security_groups": [{"name": "tempest-securitygroup--891894412"}], "key_name": "tempest-keypair-581564285", "user_data": "}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:45:07.426318 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:45:07.525999 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.network.neutron [None req-13250029-5cf7-4dcb-bbad-980c5ddfe275 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] validate_networks() for [('fea5d1fc-e591-4b70-83db-447fa0d3a485', None, None, None, None, None)] {{(pid=125486) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 11:45:07.892173 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-13250029-5cf7-4dcb-bbad-980c5ddfe275 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Flavor limits 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 11:45:07.892682 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-13250029-5cf7-4dcb-bbad-980c5ddfe275 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Image limits 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 11:45:07.893175 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-13250029-5cf7-4dcb-bbad-980c5ddfe275 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Flavor pref 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 11:45:07.893614 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-13250029-5cf7-4dcb-bbad-980c5ddfe275 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Image pref 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 11:45:07.893975 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-13250029-5cf7-4dcb-bbad-980c5ddfe275 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 11:45:07.902797 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-13250029-5cf7-4dcb-bbad-980c5ddfe275 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:07.903267 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-13250029-5cf7-4dcb-bbad-980c5ddfe275 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:07.903692 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-13250029-5cf7-4dcb-bbad-980c5ddfe275 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:07.904402 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-13250029-5cf7-4dcb-bbad-980c5ddfe275 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:07.904864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-13250029-5cf7-4dcb-bbad-980c5ddfe275 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:07.905333 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-13250029-5cf7-4dcb-bbad-980c5ddfe275 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:07.921864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-13250029-5cf7-4dcb-bbad-980c5ddfe275 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Getting quotas for project c84cfe68e5db4b2dba60443b48d23097. Resources: {'cores', 'instances', 'ram'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:45:07.925791 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-13250029-5cf7-4dcb-bbad-980c5ddfe275 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Getting quotas for user 72d748ebce2742058757304095d1a641 and project c84cfe68e5db4b2dba60443b48d23097. Resources: {'cores', 'instances', 'ram'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:45:07.937367 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-13250029-5cf7-4dcb-bbad-980c5ddfe275 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Going to run 1 instances... {{(pid=125486) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 11:45:07.939774 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-13250029-5cf7-4dcb-bbad-980c5ddfe275 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4917b56-ebe0-409a-894a-469900c12b94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 11:45:07.987001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-13250029-5cf7-4dcb-bbad-980c5ddfe275 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.574436 Oct 18 11:45:07.993500 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 300/622] 10.222.0.17 () {62 vars in 1188 bytes} [Tue Oct 18 11:45:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 11:45:07.993692 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-f8fa72e9-3f89-4d5b-851a-84901d6cd309 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:07.993692 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-f8fa72e9-3f89-4d5b-851a-84901d6cd309 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:07.999324 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-3cb1fc80-2e5e-44b2-9b15-4cbb28f7ac7a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:07.999497 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f8fa72e9-3f89-4d5b-851a-84901d6cd309 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:07.999922 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f8fa72e9-3f89-4d5b-851a-84901d6cd309 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:08.000072 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-3cb1fc80-2e5e-44b2-9b15-4cbb28f7ac7a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:08.000353 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f8fa72e9-3f89-4d5b-851a-84901d6cd309 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:08.001083 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f8fa72e9-3f89-4d5b-851a-84901d6cd309 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:08.001633 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f8fa72e9-3f89-4d5b-851a-84901d6cd309 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:08.001950 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f8fa72e9-3f89-4d5b-851a-84901d6cd309 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:08.059606 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-3cb1fc80-2e5e-44b2-9b15-4cbb28f7ac7a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:08.068018 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-3cb1fc80-2e5e-44b2-9b15-4cbb28f7ac7a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:08.069564 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-3cb1fc80-2e5e-44b2-9b15-4cbb28f7ac7a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:08.071503 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-3cb1fc80-2e5e-44b2-9b15-4cbb28f7ac7a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1279 microversion: 2.20 time: 0.076099 Oct 18 11:45:08.084905 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 301/623] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:45:07 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1279 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:45:08.144300 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-f8fa72e9-3f89-4d5b-851a-84901d6cd309 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:08.156601 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-f8fa72e9-3f89-4d5b-851a-84901d6cd309 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488" status: 200 len: 1362 microversion: 2.1 time: 0.168506 Oct 18 11:45:08.157247 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 323/624] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:07 2022] GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:08.997316 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-cdd1f910-5ee1-448e-85a2-16d5d682e94d req-843d9a6a-17ca-491b-aec4-dd8724015f91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad4d6e0a-d6d8-42b6-a448-621a32b1c488", "name": "network-vif-plugged", "status": "completed", "tag": "c37ea581-1038-42d3-af45-0da5fa44ccbd"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:45:09.008387 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-cdd1f910-5ee1-448e-85a2-16d5d682e94d req-843d9a6a-17ca-491b-aec4-dd8724015f91 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:09.008958 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-cdd1f910-5ee1-448e-85a2-16d5d682e94d req-843d9a6a-17ca-491b-aec4-dd8724015f91 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:09.009390 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-cdd1f910-5ee1-448e-85a2-16d5d682e94d req-843d9a6a-17ca-491b-aec4-dd8724015f91 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:09.021065 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-cdd1f910-5ee1-448e-85a2-16d5d682e94d req-843d9a6a-17ca-491b-aec4-dd8724015f91 service nova] Creating event network-vif-plugged:c37ea581-1038-42d3-af45-0da5fa44ccbd for instance ad4d6e0a-d6d8-42b6-a448-621a32b1c488 on hv-cinder-81558 Oct 18 11:45:09.025858 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-cdd1f910-5ee1-448e-85a2-16d5d682e94d req-843d9a6a-17ca-491b-aec4-dd8724015f91 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032422 Oct 18 11:45:09.026448 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 302/625] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:45:09.097135 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-0e0c3159-a49c-489c-a361-7710d8c27657 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:09.097733 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-0e0c3159-a49c-489c-a361-7710d8c27657 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:09.104134 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0e0c3159-a49c-489c-a361-7710d8c27657 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:09.104608 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0e0c3159-a49c-489c-a361-7710d8c27657 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:09.105067 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0e0c3159-a49c-489c-a361-7710d8c27657 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:09.105752 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0e0c3159-a49c-489c-a361-7710d8c27657 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:09.106200 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0e0c3159-a49c-489c-a361-7710d8c27657 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:09.106613 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0e0c3159-a49c-489c-a361-7710d8c27657 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:09.174404 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-0e0c3159-a49c-489c-a361-7710d8c27657 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:09.179986 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-67d49f4b-bd56-4dea-9afa-f3ceb862e099 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:09.180824 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-67d49f4b-bd56-4dea-9afa-f3ceb862e099 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:09.185544 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-0e0c3159-a49c-489c-a361-7710d8c27657 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:09.187255 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-0e0c3159-a49c-489c-a361-7710d8c27657 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:09.188781 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-67d49f4b-bd56-4dea-9afa-f3ceb862e099 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:09.189140 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-0e0c3159-a49c-489c-a361-7710d8c27657 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1331 microversion: 2.20 time: 0.095875 Oct 18 11:45:09.189696 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-67d49f4b-bd56-4dea-9afa-f3ceb862e099 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:09.189985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 324/626] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:45:09 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1331 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:45:09.190534 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-67d49f4b-bd56-4dea-9afa-f3ceb862e099 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:09.191258 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-67d49f4b-bd56-4dea-9afa-f3ceb862e099 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:09.191709 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-67d49f4b-bd56-4dea-9afa-f3ceb862e099 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:09.192671 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-67d49f4b-bd56-4dea-9afa-f3ceb862e099 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:09.417694 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-67d49f4b-bd56-4dea-9afa-f3ceb862e099 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:09.425517 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-67d49f4b-bd56-4dea-9afa-f3ceb862e099 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488" status: 200 len: 1362 microversion: 2.1 time: 0.249683 Oct 18 11:45:09.426010 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 303/627] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:09 2022] GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488 => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:10.215651 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-a8e5db39-a21b-4f3f-8ebb-58ed20bac6c4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:10.216273 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-a8e5db39-a21b-4f3f-8ebb-58ed20bac6c4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:10.222626 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a8e5db39-a21b-4f3f-8ebb-58ed20bac6c4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:10.223120 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a8e5db39-a21b-4f3f-8ebb-58ed20bac6c4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:10.223556 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a8e5db39-a21b-4f3f-8ebb-58ed20bac6c4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:10.224307 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a8e5db39-a21b-4f3f-8ebb-58ed20bac6c4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:10.224723 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a8e5db39-a21b-4f3f-8ebb-58ed20bac6c4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:10.225220 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a8e5db39-a21b-4f3f-8ebb-58ed20bac6c4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:10.367817 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-a8e5db39-a21b-4f3f-8ebb-58ed20bac6c4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:10.376483 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-a8e5db39-a21b-4f3f-8ebb-58ed20bac6c4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:10.378180 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-a8e5db39-a21b-4f3f-8ebb-58ed20bac6c4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:10.380181 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-a8e5db39-a21b-4f3f-8ebb-58ed20bac6c4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1404 microversion: 2.20 time: 0.167862 Oct 18 11:45:10.380821 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 325/628] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:45:10 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1404 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:45:10.448324 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-fec34e0b-f346-4b3f-922c-08b202428f24 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:10.449046 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-fec34e0b-f346-4b3f-922c-08b202428f24 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:10.455680 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fec34e0b-f346-4b3f-922c-08b202428f24 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:10.456172 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fec34e0b-f346-4b3f-922c-08b202428f24 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:10.456616 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fec34e0b-f346-4b3f-922c-08b202428f24 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:10.457610 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fec34e0b-f346-4b3f-922c-08b202428f24 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:10.458205 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fec34e0b-f346-4b3f-922c-08b202428f24 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:10.458635 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fec34e0b-f346-4b3f-922c-08b202428f24 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:10.671791 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-fec34e0b-f346-4b3f-922c-08b202428f24 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:10.680299 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-fec34e0b-f346-4b3f-922c-08b202428f24 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488" status: 200 len: 1362 microversion: 2.1 time: 0.235948 Oct 18 11:45:10.680896 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 304/629] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:10 2022] GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:45:11.013287 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-15f97ad1-09a8-4839-8bcf-6b7f815c529c req-a84182f4-6b5e-4d69-ab15-6d659ccd619d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb2ccf2c-f9af-4953-90e6-88ab81961afe", "tag": "f0fce60c-3686-40ed-8866-f0bdb6333f0a"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:45:11.024720 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-15f97ad1-09a8-4839-8bcf-6b7f815c529c req-a84182f4-6b5e-4d69-ab15-6d659ccd619d service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:11.025233 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-15f97ad1-09a8-4839-8bcf-6b7f815c529c req-a84182f4-6b5e-4d69-ab15-6d659ccd619d service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:11.025653 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-15f97ad1-09a8-4839-8bcf-6b7f815c529c req-a84182f4-6b5e-4d69-ab15-6d659ccd619d service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:11.037527 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-15f97ad1-09a8-4839-8bcf-6b7f815c529c req-a84182f4-6b5e-4d69-ab15-6d659ccd619d service nova] Creating event network-changed:f0fce60c-3686-40ed-8866-f0bdb6333f0a for instance bb2ccf2c-f9af-4953-90e6-88ab81961afe on hv-cinder-81558 Oct 18 11:45:11.043647 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-15f97ad1-09a8-4839-8bcf-6b7f815c529c req-a84182f4-6b5e-4d69-ab15-6d659ccd619d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034064 Oct 18 11:45:11.044245 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 326/630] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:45:11.406628 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-230dcc3f-ce6a-46a3-873d-6f1ab904d12d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:11.407234 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-230dcc3f-ce6a-46a3-873d-6f1ab904d12d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:11.413940 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-230dcc3f-ce6a-46a3-873d-6f1ab904d12d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:11.414336 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-230dcc3f-ce6a-46a3-873d-6f1ab904d12d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:11.414777 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-230dcc3f-ce6a-46a3-873d-6f1ab904d12d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:11.415476 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-230dcc3f-ce6a-46a3-873d-6f1ab904d12d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:11.415935 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-230dcc3f-ce6a-46a3-873d-6f1ab904d12d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:11.416336 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-230dcc3f-ce6a-46a3-873d-6f1ab904d12d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:11.628050 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-230dcc3f-ce6a-46a3-873d-6f1ab904d12d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:11.637163 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-230dcc3f-ce6a-46a3-873d-6f1ab904d12d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:11.638618 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-230dcc3f-ce6a-46a3-873d-6f1ab904d12d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:11.639727 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-230dcc3f-ce6a-46a3-873d-6f1ab904d12d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1404 microversion: 2.20 time: 0.237371 Oct 18 11:45:11.640288 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 305/631] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:45:11 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1404 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:45:11.703940 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-87ef84b0-7ea8-4b1a-9b40-529380bdccd2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:11.704622 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-87ef84b0-7ea8-4b1a-9b40-529380bdccd2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:11.711648 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-87ef84b0-7ea8-4b1a-9b40-529380bdccd2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:11.712125 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-87ef84b0-7ea8-4b1a-9b40-529380bdccd2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:11.712551 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-87ef84b0-7ea8-4b1a-9b40-529380bdccd2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:11.713265 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-87ef84b0-7ea8-4b1a-9b40-529380bdccd2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:11.713719 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-87ef84b0-7ea8-4b1a-9b40-529380bdccd2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:11.714135 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-87ef84b0-7ea8-4b1a-9b40-529380bdccd2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:11.847562 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-87ef84b0-7ea8-4b1a-9b40-529380bdccd2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:11.855979 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-87ef84b0-7ea8-4b1a-9b40-529380bdccd2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488" status: 200 len: 1548 microversion: 2.1 time: 0.156651 Oct 18 11:45:11.856642 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 327/632] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:11 2022] GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:11.878350 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-c531621d-14f7-44b4-8333-9bca98dd9343 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:11.878850 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-c531621d-14f7-44b4-8333-9bca98dd9343 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:11.885141 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c531621d-14f7-44b4-8333-9bca98dd9343 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:11.885634 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c531621d-14f7-44b4-8333-9bca98dd9343 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:11.886076 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c531621d-14f7-44b4-8333-9bca98dd9343 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:11.886786 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c531621d-14f7-44b4-8333-9bca98dd9343 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:11.887233 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c531621d-14f7-44b4-8333-9bca98dd9343 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:11.887656 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c531621d-14f7-44b4-8333-9bca98dd9343 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:11.967313 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-c531621d-14f7-44b4-8333-9bca98dd9343 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092792 Oct 18 11:45:11.967926 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 306/633] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Oct 18 11:45:11 2022] GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:45:12.665132 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-78f06cff-a2b1-46f0-9487-58e14c51617e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:12.665646 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-78f06cff-a2b1-46f0-9487-58e14c51617e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:12.667640 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell0:SELECT=2 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:45:12.668298 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell0:SELECT=10 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:45:12.674947 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-78f06cff-a2b1-46f0-9487-58e14c51617e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:12.675434 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-78f06cff-a2b1-46f0-9487-58e14c51617e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:12.675866 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-78f06cff-a2b1-46f0-9487-58e14c51617e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:12.677100 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-78f06cff-a2b1-46f0-9487-58e14c51617e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:12.677549 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-78f06cff-a2b1-46f0-9487-58e14c51617e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:12.677970 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-78f06cff-a2b1-46f0-9487-58e14c51617e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:12.930199 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-78f06cff-a2b1-46f0-9487-58e14c51617e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:12.938916 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-78f06cff-a2b1-46f0-9487-58e14c51617e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:12.940383 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-78f06cff-a2b1-46f0-9487-58e14c51617e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:12.941564 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-78f06cff-a2b1-46f0-9487-58e14c51617e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1404 microversion: 2.20 time: 0.280534 Oct 18 11:45:12.942129 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 328/634] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:45:12 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1404 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:45:13.255038 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-7a660391-28cc-4a7b-b1c3-bdce99741ac3 req-6884d484-f403-4eed-8d3a-833b9c7c78f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad4d6e0a-d6d8-42b6-a448-621a32b1c488", "tag": "c37ea581-1038-42d3-af45-0da5fa44ccbd"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:45:13.265382 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-7a660391-28cc-4a7b-b1c3-bdce99741ac3 req-6884d484-f403-4eed-8d3a-833b9c7c78f8 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:13.265941 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-7a660391-28cc-4a7b-b1c3-bdce99741ac3 req-6884d484-f403-4eed-8d3a-833b9c7c78f8 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:13.266425 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-7a660391-28cc-4a7b-b1c3-bdce99741ac3 req-6884d484-f403-4eed-8d3a-833b9c7c78f8 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:13.278171 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-7a660391-28cc-4a7b-b1c3-bdce99741ac3 req-6884d484-f403-4eed-8d3a-833b9c7c78f8 service nova] Creating event network-changed:c37ea581-1038-42d3-af45-0da5fa44ccbd for instance ad4d6e0a-d6d8-42b6-a448-621a32b1c488 on hv-cinder-81558 Oct 18 11:45:13.283430 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-7a660391-28cc-4a7b-b1c3-bdce99741ac3 req-6884d484-f403-4eed-8d3a-833b9c7c78f8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032541 Oct 18 11:45:13.284028 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 307/635] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:45:13.966469 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-5a796a00-6866-46ff-bc31-1f39b4820a11 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:13.967078 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-5a796a00-6866-46ff-bc31-1f39b4820a11 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:13.974124 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5a796a00-6866-46ff-bc31-1f39b4820a11 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:13.974610 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5a796a00-6866-46ff-bc31-1f39b4820a11 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:13.975045 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5a796a00-6866-46ff-bc31-1f39b4820a11 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:13.975743 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5a796a00-6866-46ff-bc31-1f39b4820a11 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:13.976196 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5a796a00-6866-46ff-bc31-1f39b4820a11 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:13.976620 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5a796a00-6866-46ff-bc31-1f39b4820a11 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:14.112925 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-5a796a00-6866-46ff-bc31-1f39b4820a11 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:14.121341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-5a796a00-6866-46ff-bc31-1f39b4820a11 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:14.122823 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-5a796a00-6866-46ff-bc31-1f39b4820a11 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:14.123936 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-5a796a00-6866-46ff-bc31-1f39b4820a11 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1404 microversion: 2.20 time: 0.161550 Oct 18 11:45:14.124472 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 329/636] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:45:13 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1404 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:45:15.150373 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-00be87ff-c8aa-4ef2-a736-1eadad424461 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:15.151744 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-00be87ff-c8aa-4ef2-a736-1eadad424461 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:15.157451 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-00be87ff-c8aa-4ef2-a736-1eadad424461 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:15.157948 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-00be87ff-c8aa-4ef2-a736-1eadad424461 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:15.158376 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-00be87ff-c8aa-4ef2-a736-1eadad424461 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:15.159078 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-00be87ff-c8aa-4ef2-a736-1eadad424461 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:15.159523 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-00be87ff-c8aa-4ef2-a736-1eadad424461 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:15.159941 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-00be87ff-c8aa-4ef2-a736-1eadad424461 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:15.304514 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-00be87ff-c8aa-4ef2-a736-1eadad424461 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:15.312550 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-00be87ff-c8aa-4ef2-a736-1eadad424461 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:15.314015 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-00be87ff-c8aa-4ef2-a736-1eadad424461 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:15.315143 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-00be87ff-c8aa-4ef2-a736-1eadad424461 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1404 microversion: 2.20 time: 0.169828 Oct 18 11:45:15.315698 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 308/637] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:45:15 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1404 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:45:16.339776 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-899b5d70-7f97-47dd-9717-9156677dadfa tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:16.340563 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-899b5d70-7f97-47dd-9717-9156677dadfa tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:16.346924 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-899b5d70-7f97-47dd-9717-9156677dadfa tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:16.347416 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-899b5d70-7f97-47dd-9717-9156677dadfa tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:16.347839 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-899b5d70-7f97-47dd-9717-9156677dadfa tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:16.348522 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-899b5d70-7f97-47dd-9717-9156677dadfa tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:16.348991 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-899b5d70-7f97-47dd-9717-9156677dadfa tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:16.349402 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-899b5d70-7f97-47dd-9717-9156677dadfa tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:16.480727 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-899b5d70-7f97-47dd-9717-9156677dadfa tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:16.488712 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-899b5d70-7f97-47dd-9717-9156677dadfa tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:16.490780 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-899b5d70-7f97-47dd-9717-9156677dadfa tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:16.491877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-899b5d70-7f97-47dd-9717-9156677dadfa tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1404 microversion: 2.20 time: 0.156045 Oct 18 11:45:16.492435 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 330/638] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:45:16 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:45:17.027547 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-3408edb1-dc6c-498c-b0c3-7b675c66c36f req-5e1a946c-9ba4-4099-b502-ab457c89a9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb2ccf2c-f9af-4953-90e6-88ab81961afe", "name": "network-vif-plugged", "status": "completed", "tag": "f0fce60c-3686-40ed-8866-f0bdb6333f0a"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:45:17.038712 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-3408edb1-dc6c-498c-b0c3-7b675c66c36f req-5e1a946c-9ba4-4099-b502-ab457c89a9c1 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:17.039191 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-3408edb1-dc6c-498c-b0c3-7b675c66c36f req-5e1a946c-9ba4-4099-b502-ab457c89a9c1 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:17.039615 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-3408edb1-dc6c-498c-b0c3-7b675c66c36f req-5e1a946c-9ba4-4099-b502-ab457c89a9c1 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:17.055133 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-3408edb1-dc6c-498c-b0c3-7b675c66c36f req-5e1a946c-9ba4-4099-b502-ab457c89a9c1 service nova] Creating event network-vif-plugged:f0fce60c-3686-40ed-8866-f0bdb6333f0a for instance bb2ccf2c-f9af-4953-90e6-88ab81961afe on hv-cinder-81558 Oct 18 11:45:17.060016 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-3408edb1-dc6c-498c-b0c3-7b675c66c36f req-5e1a946c-9ba4-4099-b502-ab457c89a9c1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036554 Oct 18 11:45:17.060778 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 309/639] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:45:17.516620 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ab5f6f3b-c70f-4721-b41f-dfe1be6ef2d8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:17.517243 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-ab5f6f3b-c70f-4721-b41f-dfe1be6ef2d8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:17.523879 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ab5f6f3b-c70f-4721-b41f-dfe1be6ef2d8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:17.524359 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ab5f6f3b-c70f-4721-b41f-dfe1be6ef2d8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:17.524791 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ab5f6f3b-c70f-4721-b41f-dfe1be6ef2d8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:17.525525 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ab5f6f3b-c70f-4721-b41f-dfe1be6ef2d8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:17.525972 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ab5f6f3b-c70f-4721-b41f-dfe1be6ef2d8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:17.526388 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ab5f6f3b-c70f-4721-b41f-dfe1be6ef2d8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:17.657078 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-ab5f6f3b-c70f-4721-b41f-dfe1be6ef2d8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:17.665084 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-ab5f6f3b-c70f-4721-b41f-dfe1be6ef2d8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:17.666513 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-ab5f6f3b-c70f-4721-b41f-dfe1be6ef2d8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:17.667601 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-ab5f6f3b-c70f-4721-b41f-dfe1be6ef2d8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1404 microversion: 2.20 time: 0.155292 Oct 18 11:45:17.668155 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 331/640] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:45:17 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:45:18.691474 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell0:SELECT=2 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:45:18.693272 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell0:SELECT=14 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:45:18.697622 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-c7b2bc03-d6a1-4e21-8fee-000dc90b13d1 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:18.698307 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-c7b2bc03-d6a1-4e21-8fee-000dc90b13d1 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:18.705379 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c7b2bc03-d6a1-4e21-8fee-000dc90b13d1 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:18.705851 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c7b2bc03-d6a1-4e21-8fee-000dc90b13d1 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:18.706280 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c7b2bc03-d6a1-4e21-8fee-000dc90b13d1 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:18.706958 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c7b2bc03-d6a1-4e21-8fee-000dc90b13d1 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:18.707666 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c7b2bc03-d6a1-4e21-8fee-000dc90b13d1 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:18.708135 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c7b2bc03-d6a1-4e21-8fee-000dc90b13d1 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:18.847467 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-c7b2bc03-d6a1-4e21-8fee-000dc90b13d1 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:18.856724 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-c7b2bc03-d6a1-4e21-8fee-000dc90b13d1 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:18.858178 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-c7b2bc03-d6a1-4e21-8fee-000dc90b13d1 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:18.859313 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-c7b2bc03-d6a1-4e21-8fee-000dc90b13d1 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1404 microversion: 2.20 time: 0.168872 Oct 18 11:45:18.859867 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 310/641] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:45:18 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1404 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:45:19.884075 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-8db47fb3-78ad-4871-a76d-9a63aee6f764 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:19.884693 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-8db47fb3-78ad-4871-a76d-9a63aee6f764 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:19.891040 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8db47fb3-78ad-4871-a76d-9a63aee6f764 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:19.891513 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8db47fb3-78ad-4871-a76d-9a63aee6f764 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:19.891933 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8db47fb3-78ad-4871-a76d-9a63aee6f764 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:19.892601 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8db47fb3-78ad-4871-a76d-9a63aee6f764 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:19.893083 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8db47fb3-78ad-4871-a76d-9a63aee6f764 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:19.893498 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8db47fb3-78ad-4871-a76d-9a63aee6f764 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:19.912346 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=100 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:45:20.077954 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-8db47fb3-78ad-4871-a76d-9a63aee6f764 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:20.086256 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-8db47fb3-78ad-4871-a76d-9a63aee6f764 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:20.087682 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-8db47fb3-78ad-4871-a76d-9a63aee6f764 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:20.088883 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-8db47fb3-78ad-4871-a76d-9a63aee6f764 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1597 microversion: 2.20 time: 0.209212 Oct 18 11:45:20.089411 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 332/642] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:45:19 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1597 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:45:20.113179 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-d32591cf-7063-413c-92d4-24e43d694dac tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:20.113731 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-d32591cf-7063-413c-92d4-24e43d694dac tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:20.120588 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d32591cf-7063-413c-92d4-24e43d694dac tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:20.121096 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d32591cf-7063-413c-92d4-24e43d694dac tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:20.121520 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d32591cf-7063-413c-92d4-24e43d694dac tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:20.122199 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d32591cf-7063-413c-92d4-24e43d694dac tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:20.123471 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d32591cf-7063-413c-92d4-24e43d694dac tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:20.123471 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d32591cf-7063-413c-92d4-24e43d694dac tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:20.262170 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-d32591cf-7063-413c-92d4-24e43d694dac tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.152900 Oct 18 11:45:20.262769 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 311/643] 10.222.0.17 () {60 vars in 1316 bytes} [Tue Oct 18 11:45:20 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe/os-interface => generated 285 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 11:45:20.564866 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-174e84b5-96b6-48e3-b6eb-ca649dd378e3 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:20.565361 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-174e84b5-96b6-48e3-b6eb-ca649dd378e3 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:20.571668 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-174e84b5-96b6-48e3-b6eb-ca649dd378e3 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:20.572144 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-174e84b5-96b6-48e3-b6eb-ca649dd378e3 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:20.572564 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-174e84b5-96b6-48e3-b6eb-ca649dd378e3 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:20.573284 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-174e84b5-96b6-48e3-b6eb-ca649dd378e3 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:20.573778 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-174e84b5-96b6-48e3-b6eb-ca649dd378e3 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:20.574146 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-174e84b5-96b6-48e3-b6eb-ca649dd378e3 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:20.659930 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.objects.instance [None req-174e84b5-96b6-48e3-b6eb-ca649dd378e3 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lazy-loading 'services' on Instance uuid 3f737271-603e-4448-b37d-4a5ae83dd052 {{(pid=125485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:45:20.717657 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-3ab7059a-58f0-4b0b-bfce-ce63e7936feb tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-681467887"}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:45:20.718293 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-3ab7059a-58f0-4b0b-bfce-ce63e7936feb tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:20.725108 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3ab7059a-58f0-4b0b-bfce-ce63e7936feb tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:20.725602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3ab7059a-58f0-4b0b-bfce-ce63e7936feb tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:20.729431 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3ab7059a-58f0-4b0b-bfce-ce63e7936feb tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:20.730234 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3ab7059a-58f0-4b0b-bfce-ce63e7936feb tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:20.730802 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3ab7059a-58f0-4b0b-bfce-ce63e7936feb tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:20.731298 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3ab7059a-58f0-4b0b-bfce-ce63e7936feb tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:20.748928 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-174e84b5-96b6-48e3-b6eb-ca649dd378e3 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052/os-volume_attachments/58fb065d-ccab-4904-98fe-c598c0060524" status: 202 len: 0 microversion: 2.1 time: 0.188066 Oct 18 11:45:20.749732 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 333/644] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Oct 18 11:45:20 2022] DELETE /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052/os-volume_attachments/58fb065d-ccab-4904-98fe-c598c0060524 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 11:45:20.758775 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-5753f5b9-6793-44c7-bba6-2a340cf6a633 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:20.774809 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-5753f5b9-6793-44c7-bba6-2a340cf6a633 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:20.783894 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5753f5b9-6793-44c7-bba6-2a340cf6a633 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:20.785183 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5753f5b9-6793-44c7-bba6-2a340cf6a633 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:20.785741 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5753f5b9-6793-44c7-bba6-2a340cf6a633 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:20.787293 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5753f5b9-6793-44c7-bba6-2a340cf6a633 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:20.787999 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5753f5b9-6793-44c7-bba6-2a340cf6a633 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:20.788383 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5753f5b9-6793-44c7-bba6-2a340cf6a633 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:20.831297 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-5753f5b9-6793-44c7-bba6-2a340cf6a633 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077101 Oct 18 11:45:20.836945 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 334/645] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Oct 18 11:45:20 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:45:20.889811 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.network.security_group_api [None req-3ab7059a-58f0-4b0b-bfce-ce63e7936feb tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Removing security group d68e1368-1fe2-42c7-a727-14ec310f05e4 from port dad12b9b-8fc3-457f-a59d-d7e7760984cc Oct 18 11:45:21.211172 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-3ab7059a-58f0-4b0b-bfce-ce63e7936feb tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "POST /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e/action" status: 202 len: 0 microversion: 2.1 time: 0.497221 Oct 18 11:45:21.214952 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 312/646] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Oct 18 11:45:20 2022] POST /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e/action => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 11:45:21.250079 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-8d449f64-f691-42fd-8c93-7b3e28f71604 req-32e49982-d436-41d3-80cb-3f02c972d616 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fc6ee0a-b135-42dc-9099-30672626af2e", "tag": "dad12b9b-8fc3-457f-a59d-d7e7760984cc"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:45:21.279369 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-8d449f64-f691-42fd-8c93-7b3e28f71604 req-32e49982-d436-41d3-80cb-3f02c972d616 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:21.279889 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-8d449f64-f691-42fd-8c93-7b3e28f71604 req-32e49982-d436-41d3-80cb-3f02c972d616 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:21.280336 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-8d449f64-f691-42fd-8c93-7b3e28f71604 req-32e49982-d436-41d3-80cb-3f02c972d616 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:21.296647 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-8d449f64-f691-42fd-8c93-7b3e28f71604 req-32e49982-d436-41d3-80cb-3f02c972d616 service nova] Creating event network-changed:dad12b9b-8fc3-457f-a59d-d7e7760984cc for instance 0fc6ee0a-b135-42dc-9099-30672626af2e on hv-cinder-81558 Oct 18 11:45:21.304554 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-8d449f64-f691-42fd-8c93-7b3e28f71604 req-32e49982-d436-41d3-80cb-3f02c972d616 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069733 Oct 18 11:45:21.305714 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 335/647] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:45:21.567923 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-ae6ca09e-cb62-4b97-aae5-c173dfad4bde req-68cba29a-45d5-4707-84ae-ce0e811b04a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb2ccf2c-f9af-4953-90e6-88ab81961afe", "tag": "f0fce60c-3686-40ed-8866-f0bdb6333f0a"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:45:21.586963 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-ae6ca09e-cb62-4b97-aae5-c173dfad4bde req-68cba29a-45d5-4707-84ae-ce0e811b04a9 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:21.587454 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-ae6ca09e-cb62-4b97-aae5-c173dfad4bde req-68cba29a-45d5-4707-84ae-ce0e811b04a9 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:21.587886 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-ae6ca09e-cb62-4b97-aae5-c173dfad4bde req-68cba29a-45d5-4707-84ae-ce0e811b04a9 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:21.620869 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-ae6ca09e-cb62-4b97-aae5-c173dfad4bde req-68cba29a-45d5-4707-84ae-ce0e811b04a9 service nova] Creating event network-changed:f0fce60c-3686-40ed-8866-f0bdb6333f0a for instance bb2ccf2c-f9af-4953-90e6-88ab81961afe on hv-cinder-81558 Oct 18 11:45:21.633227 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-ae6ca09e-cb62-4b97-aae5-c173dfad4bde req-68cba29a-45d5-4707-84ae-ce0e811b04a9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069617 Oct 18 11:45:21.637116 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 313/648] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:45:21.862812 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-da455ce1-c5be-4642-85de-810dbfe250ad tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:21.867438 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-da455ce1-c5be-4642-85de-810dbfe250ad tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:21.904806 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-da455ce1-c5be-4642-85de-810dbfe250ad tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:21.907280 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-da455ce1-c5be-4642-85de-810dbfe250ad tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:21.910003 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-da455ce1-c5be-4642-85de-810dbfe250ad tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:21.911899 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-da455ce1-c5be-4642-85de-810dbfe250ad tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:21.913181 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-da455ce1-c5be-4642-85de-810dbfe250ad tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:21.915331 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-da455ce1-c5be-4642-85de-810dbfe250ad tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:21.976394 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-da455ce1-c5be-4642-85de-810dbfe250ad tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.134898 Oct 18 11:45:21.977434 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 336/649] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Oct 18 11:45:21 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052/os-volume_attachments => generated 25 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 11:45:22.066771 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-f302c12c-5982-4b65-a4c9-96784a59cd6a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:22.068231 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-f302c12c-5982-4b65-a4c9-96784a59cd6a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:22.075928 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f302c12c-5982-4b65-a4c9-96784a59cd6a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:22.076736 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f302c12c-5982-4b65-a4c9-96784a59cd6a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:22.077372 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f302c12c-5982-4b65-a4c9-96784a59cd6a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:22.079454 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f302c12c-5982-4b65-a4c9-96784a59cd6a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:22.080156 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f302c12c-5982-4b65-a4c9-96784a59cd6a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:22.080759 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f302c12c-5982-4b65-a4c9-96784a59cd6a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:22.114859 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-f302c12c-5982-4b65-a4c9-96784a59cd6a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Going to try to terminate instance {{(pid=125486) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 11:45:22.241208 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-f302c12c-5982-4b65-a4c9-96784a59cd6a tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 204 len: 0 microversion: 2.1 time: 0.180244 Oct 18 11:45:22.241897 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 314/650] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Oct 18 11:45:22 2022] DELETE /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 11:45:22.251918 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-0ace9b99-821b-4831-9ae5-d95dc83aa35c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:22.253377 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-0ace9b99-821b-4831-9ae5-d95dc83aa35c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:22.269068 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0ace9b99-821b-4831-9ae5-d95dc83aa35c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:22.270063 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0ace9b99-821b-4831-9ae5-d95dc83aa35c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:22.270859 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0ace9b99-821b-4831-9ae5-d95dc83aa35c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:22.273136 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0ace9b99-821b-4831-9ae5-d95dc83aa35c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:22.273862 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0ace9b99-821b-4831-9ae5-d95dc83aa35c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:22.277191 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0ace9b99-821b-4831-9ae5-d95dc83aa35c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:22.544686 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-0ace9b99-821b-4831-9ae5-d95dc83aa35c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:22.554135 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-0ace9b99-821b-4831-9ae5-d95dc83aa35c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1689 microversion: 2.1 time: 0.307275 Oct 18 11:45:22.555119 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 337/651] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:22 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1689 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:23.071724 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-2d3b0577-6acf-43d9-8360-21caf944e69f tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:23.072310 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-2d3b0577-6acf-43d9-8360-21caf944e69f tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:23.078625 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2d3b0577-6acf-43d9-8360-21caf944e69f tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:23.079110 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2d3b0577-6acf-43d9-8360-21caf944e69f tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:23.079536 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2d3b0577-6acf-43d9-8360-21caf944e69f tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:23.080238 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2d3b0577-6acf-43d9-8360-21caf944e69f tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:23.080681 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2d3b0577-6acf-43d9-8360-21caf944e69f tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:23.081125 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2d3b0577-6acf-43d9-8360-21caf944e69f tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:23.172357 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.objects.instance [None req-2d3b0577-6acf-43d9-8360-21caf944e69f tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lazy-loading 'services' on Instance uuid 0fc6ee0a-b135-42dc-9099-30672626af2e {{(pid=125486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:45:23.261189 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-2d3b0577-6acf-43d9-8360-21caf944e69f tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e/os-volume_attachments/0a3c86e6-31af-4e02-bd73-76aeb83e8df1" status: 202 len: 0 microversion: 2.1 time: 0.193681 Oct 18 11:45:23.262201 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 315/652] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Oct 18 11:45:23 2022] DELETE /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e/os-volume_attachments/0a3c86e6-31af-4e02-bd73-76aeb83e8df1 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 11:45:23.270121 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-709fe04a-bd62-4b71-90e6-2e1f798baf9e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:23.273155 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-709fe04a-bd62-4b71-90e6-2e1f798baf9e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:23.279716 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-709fe04a-bd62-4b71-90e6-2e1f798baf9e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:23.280135 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-709fe04a-bd62-4b71-90e6-2e1f798baf9e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:23.280567 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-709fe04a-bd62-4b71-90e6-2e1f798baf9e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:23.281549 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-709fe04a-bd62-4b71-90e6-2e1f798baf9e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:23.282002 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-709fe04a-bd62-4b71-90e6-2e1f798baf9e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:23.282625 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-709fe04a-bd62-4b71-90e6-2e1f798baf9e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:23.312283 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-709fe04a-bd62-4b71-90e6-2e1f798baf9e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046040 Oct 18 11:45:23.312875 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 338/653] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Oct 18 11:45:23 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:45:23.577404 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-7085e48d-db48-4b47-9548-e63780cd2bf1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:23.578021 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-7085e48d-db48-4b47-9548-e63780cd2bf1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:23.585402 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7085e48d-db48-4b47-9548-e63780cd2bf1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:23.585894 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7085e48d-db48-4b47-9548-e63780cd2bf1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:23.586333 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7085e48d-db48-4b47-9548-e63780cd2bf1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:23.587038 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7085e48d-db48-4b47-9548-e63780cd2bf1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:23.587491 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7085e48d-db48-4b47-9548-e63780cd2bf1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:23.587913 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7085e48d-db48-4b47-9548-e63780cd2bf1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:23.724292 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-7085e48d-db48-4b47-9548-e63780cd2bf1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:23.728469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:45:23.734524 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-7085e48d-db48-4b47-9548-e63780cd2bf1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1689 microversion: 2.1 time: 0.161442 Oct 18 11:45:23.735106 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 316/654] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:23 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:45:23.741515 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-0242f9ce-e4cb-4b88-b98c-7d1f5167634d req-028326ca-a8a9-4b32-8279-6385c8049c5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fc6ee0a-b135-42dc-9099-30672626af2e", "tag": "dad12b9b-8fc3-457f-a59d-d7e7760984cc"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:45:23.751976 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-0242f9ce-e4cb-4b88-b98c-7d1f5167634d req-028326ca-a8a9-4b32-8279-6385c8049c5e service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:23.752445 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-0242f9ce-e4cb-4b88-b98c-7d1f5167634d req-028326ca-a8a9-4b32-8279-6385c8049c5e service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:23.752892 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-0242f9ce-e4cb-4b88-b98c-7d1f5167634d req-028326ca-a8a9-4b32-8279-6385c8049c5e service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:23.764165 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-0242f9ce-e4cb-4b88-b98c-7d1f5167634d req-028326ca-a8a9-4b32-8279-6385c8049c5e service nova] Creating event network-changed:dad12b9b-8fc3-457f-a59d-d7e7760984cc for instance 0fc6ee0a-b135-42dc-9099-30672626af2e on hv-cinder-81558 Oct 18 11:45:23.769415 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-0242f9ce-e4cb-4b88-b98c-7d1f5167634d req-028326ca-a8a9-4b32-8279-6385c8049c5e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039795 Oct 18 11:45:23.770020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 339/655] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:45:24.325198 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-4fcc71b9-75c2-4de7-984e-f1bcea17db2e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:24.327508 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-4fcc71b9-75c2-4de7-984e-f1bcea17db2e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:24.335223 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4fcc71b9-75c2-4de7-984e-f1bcea17db2e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:24.335698 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4fcc71b9-75c2-4de7-984e-f1bcea17db2e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:24.336126 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4fcc71b9-75c2-4de7-984e-f1bcea17db2e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:24.336801 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4fcc71b9-75c2-4de7-984e-f1bcea17db2e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:24.337282 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4fcc71b9-75c2-4de7-984e-f1bcea17db2e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:24.337682 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4fcc71b9-75c2-4de7-984e-f1bcea17db2e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:24.367186 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-4fcc71b9-75c2-4de7-984e-f1bcea17db2e tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046042 Oct 18 11:45:24.367745 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 317/656] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Oct 18 11:45:24 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:45:24.758958 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-d647913f-150c-4dd6-b51e-7ea2759ee1be tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:24.759644 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-d647913f-150c-4dd6-b51e-7ea2759ee1be tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:24.766250 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d647913f-150c-4dd6-b51e-7ea2759ee1be tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:24.766726 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d647913f-150c-4dd6-b51e-7ea2759ee1be tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:24.767158 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d647913f-150c-4dd6-b51e-7ea2759ee1be tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:24.767839 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d647913f-150c-4dd6-b51e-7ea2759ee1be tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:24.768284 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d647913f-150c-4dd6-b51e-7ea2759ee1be tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:24.768703 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d647913f-150c-4dd6-b51e-7ea2759ee1be tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:24.901170 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-d647913f-150c-4dd6-b51e-7ea2759ee1be tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:24.908736 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-d647913f-150c-4dd6-b51e-7ea2759ee1be tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1689 microversion: 2.1 time: 0.153969 Oct 18 11:45:24.909335 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 340/657] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:24 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:25.379931 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-dffc9e4c-db1a-4da7-be80-e5b335734987 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:25.382083 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-dffc9e4c-db1a-4da7-be80-e5b335734987 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:25.388505 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dffc9e4c-db1a-4da7-be80-e5b335734987 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:25.389017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dffc9e4c-db1a-4da7-be80-e5b335734987 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:25.389455 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dffc9e4c-db1a-4da7-be80-e5b335734987 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:25.390133 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dffc9e4c-db1a-4da7-be80-e5b335734987 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:25.390580 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dffc9e4c-db1a-4da7-be80-e5b335734987 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:25.390999 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dffc9e4c-db1a-4da7-be80-e5b335734987 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:25.421856 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-dffc9e4c-db1a-4da7-be80-e5b335734987 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045969 Oct 18 11:45:25.422418 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 318/658] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Oct 18 11:45:25 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:45:25.933610 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-79d3c616-b667-4c4c-b9f6-87ea89945e80 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:25.934205 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-79d3c616-b667-4c4c-b9f6-87ea89945e80 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:25.940450 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-79d3c616-b667-4c4c-b9f6-87ea89945e80 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:25.940968 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-79d3c616-b667-4c4c-b9f6-87ea89945e80 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:25.941398 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-79d3c616-b667-4c4c-b9f6-87ea89945e80 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:25.942082 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-79d3c616-b667-4c4c-b9f6-87ea89945e80 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:25.943132 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-79d3c616-b667-4c4c-b9f6-87ea89945e80 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:25.943549 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-79d3c616-b667-4c4c-b9f6-87ea89945e80 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:26.070587 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-79d3c616-b667-4c4c-b9f6-87ea89945e80 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:26.078204 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-79d3c616-b667-4c4c-b9f6-87ea89945e80 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1689 microversion: 2.1 time: 0.148489 Oct 18 11:45:26.078754 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 341/659] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:25 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:26.436016 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-46cab87d-3eb2-4b01-b052-b4ec483d84b6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:26.438367 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-46cab87d-3eb2-4b01-b052-b4ec483d84b6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:26.445651 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-46cab87d-3eb2-4b01-b052-b4ec483d84b6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:26.446509 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-46cab87d-3eb2-4b01-b052-b4ec483d84b6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:26.447040 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-46cab87d-3eb2-4b01-b052-b4ec483d84b6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:26.447994 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-46cab87d-3eb2-4b01-b052-b4ec483d84b6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:26.448441 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-46cab87d-3eb2-4b01-b052-b4ec483d84b6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:26.448871 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-46cab87d-3eb2-4b01-b052-b4ec483d84b6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:26.481560 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-46cab87d-3eb2-4b01-b052-b4ec483d84b6 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050683 Oct 18 11:45:26.482423 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 319/660] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Oct 18 11:45:26 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:45:27.101448 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-2b44b8da-c417-4a20-84f5-ac6d7e49f5e8 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:27.102734 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-2b44b8da-c417-4a20-84f5-ac6d7e49f5e8 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:27.109305 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2b44b8da-c417-4a20-84f5-ac6d7e49f5e8 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:27.109784 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2b44b8da-c417-4a20-84f5-ac6d7e49f5e8 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:27.110220 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2b44b8da-c417-4a20-84f5-ac6d7e49f5e8 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:27.110913 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2b44b8da-c417-4a20-84f5-ac6d7e49f5e8 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:27.111362 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2b44b8da-c417-4a20-84f5-ac6d7e49f5e8 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:27.111782 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-2b44b8da-c417-4a20-84f5-ac6d7e49f5e8 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:27.175889 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-2b44b8da-c417-4a20-84f5-ac6d7e49f5e8 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:27.192824 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-2b44b8da-c417-4a20-84f5-ac6d7e49f5e8 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1622 microversion: 2.1 time: 0.094763 Oct 18 11:45:27.193800 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 342/661] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:27 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1622 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:27.466379 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-b8d22949-d9c1-4908-a590-1f5ab48a9efb req-d15ed398-7371-4be4-96d5-1fc4e3764871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f737271-603e-4448-b37d-4a5ae83dd052", "name": "network-vif-deleted", "tag": "068b5a44-602c-41f5-93ae-92aab177d2c9"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:45:27.476355 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-b8d22949-d9c1-4908-a590-1f5ab48a9efb req-d15ed398-7371-4be4-96d5-1fc4e3764871 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:27.476867 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-b8d22949-d9c1-4908-a590-1f5ab48a9efb req-d15ed398-7371-4be4-96d5-1fc4e3764871 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:27.477317 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-b8d22949-d9c1-4908-a590-1f5ab48a9efb req-d15ed398-7371-4be4-96d5-1fc4e3764871 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:27.489659 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-b8d22949-d9c1-4908-a590-1f5ab48a9efb req-d15ed398-7371-4be4-96d5-1fc4e3764871 service nova] Creating event network-vif-deleted:068b5a44-602c-41f5-93ae-92aab177d2c9 for instance 3f737271-603e-4448-b37d-4a5ae83dd052 on hv-cinder-81558 Oct 18 11:45:27.494894 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-b8d22949-d9c1-4908-a590-1f5ab48a9efb req-d15ed398-7371-4be4-96d5-1fc4e3764871 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032215 Oct 18 11:45:27.495693 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 320/662] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:45:27.496133 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-1b542c63-a590-486c-83ed-43d5b22faa56 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:27.498659 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-1b542c63-a590-486c-83ed-43d5b22faa56 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:27.506352 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1b542c63-a590-486c-83ed-43d5b22faa56 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:27.506841 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1b542c63-a590-486c-83ed-43d5b22faa56 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:27.507453 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1b542c63-a590-486c-83ed-43d5b22faa56 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:27.508325 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1b542c63-a590-486c-83ed-43d5b22faa56 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:27.509002 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1b542c63-a590-486c-83ed-43d5b22faa56 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:27.509825 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1b542c63-a590-486c-83ed-43d5b22faa56 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:27.544735 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-1b542c63-a590-486c-83ed-43d5b22faa56 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052724 Oct 18 11:45:27.545344 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 343/663] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Oct 18 11:45:27 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 11:45:27.557362 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-6a3538de-2393-4543-b7ab-564525d155d7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:27.557916 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-6a3538de-2393-4543-b7ab-564525d155d7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:27.564523 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6a3538de-2393-4543-b7ab-564525d155d7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:27.565182 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6a3538de-2393-4543-b7ab-564525d155d7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:27.565828 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6a3538de-2393-4543-b7ab-564525d155d7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:27.566546 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6a3538de-2393-4543-b7ab-564525d155d7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:27.567079 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6a3538de-2393-4543-b7ab-564525d155d7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:27.568004 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6a3538de-2393-4543-b7ab-564525d155d7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:27.649439 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.wsgi [None req-6a3538de-2393-4543-b7ab-564525d155d7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] HTTP exception thrown: Instance 0fc6ee0a-b135-42dc-9099-30672626af2e is not attached to volume 0a3c86e6-31af-4e02-bd73-76aeb83e8df1 Oct 18 11:45:27.659450 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-6a3538de-2393-4543-b7ab-564525d155d7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Request method failure captured: Oct 18 11:45:27.659450 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: request: DELETE /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e/os-volume_attachments/0a3c86e6-31af-4e02-bd73-76aeb83e8df1 HTTP/1.1 Oct 18 11:45:27.659450 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept: application/json Oct 18 11:45:27.659450 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept-Encoding: identity Oct 18 11:45:27.659450 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Connection: close Oct 18 11:45:27.659450 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Length: 0 Oct 18 11:45:27.659450 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Type: application/json Oct 18 11:45:27.659450 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Host: 10.222.0.17 Oct 18 11:45:27.659450 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Openstack-System-Scope: None Oct 18 11:45:27.659450 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: User-Agent: python-urllib3/1.26.12 Oct 18 11:45:27.659450 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Auth-Token: gAAAAABjTpETnxdqUxIfICUxCd1yIP2CWgkGb-Kw8BxAjibtqYc2_VZRex-LOCP94hRgfcowI2bdFUkx6Cj8RrdUaVl8f0agX2ajKKcs4BEes9X-HlwG9MPNSrKHcIriQzsMX4rZhC9kOAXDAZsi3eDn8LAlS_DhWjYKVYrT3L5MnZRdF1hu9b4 Oct 18 11:45:27.659450 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Id: None Oct 18 11:45:27.659450 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Name: None Oct 18 11:45:27.659450 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Identity-Status: Confirmed Oct 18 11:45:27.659450 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Is-Admin-Project: True Oct 18 11:45:27.659450 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Id: default Oct 18 11:45:27.659450 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Name: Default Oct 18 11:45:27.659450 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Id: b63f8bd1dce742b09e413947db416e66 Oct 18 11:45:27.659450 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Name: tempest-TestMinimumBasicScenario-1767014436 Oct 18 11:45:27.659450 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Role: reader,member Oct 18 11:45:27.659450 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Roles: reader,member Oct 18 11:45:27.661255 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b63f8bd1dce742b09e413947db416e66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b63f8bd1dce742b09e413947db416e66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b63f8bd1dce742b09e413947db416e66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b63f8bd1dce742b09e413947db416e66"}]}] Oct 18 11:45:27.661255 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant: tempest-TestMinimumBasicScenario-1767014436 Oct 18 11:45:27.661255 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Id: b63f8bd1dce742b09e413947db416e66 Oct 18 11:45:27.661255 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1767014436 Oct 18 11:45:27.661255 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User: tempest-TestMinimumBasicScenario-1767014436-project Oct 18 11:45:27.661255 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Id: default Oct 18 11:45:27.661255 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Name: Default Oct 18 11:45:27.661255 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Id: b9fed14900304dc99c4c1d5fdfe204af Oct 18 11:45:27.661255 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Name: tempest-TestMinimumBasicScenario-1767014436-project Oct 18 11:45:27.661255 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: method: > Oct 18 11:45:27.661255 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: exception: Instance 0fc6ee0a-b135-42dc-9099-30672626af2e is not attached to volume 0a3c86e6-31af-4e02-bd73-76aeb83e8df1 Oct 18 11:45:27.662130 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: action_args: {'server_id': '0fc6ee0a-b135-42dc-9099-30672626af2e', 'id': '0a3c86e6-31af-4e02-bd73-76aeb83e8df1'} Oct 18 11:45:27.662130 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:45:27.662130 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:45:27.662130 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 18 11:45:27.662130 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 18 11:45:27.662130 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 11:45:27.662130 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 11:45:27.662130 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 18 11:45:27.662130 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 18 11:45:27.662130 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0a3c86e6-31af-4e02-bd73-76aeb83e8df1. Oct 18 11:45:27.662130 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:45:27.662130 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:45:27.662130 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:45:27.662130 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:45:27.662130 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:45:27.662130 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:45:27.662130 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:45:27.662130 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:45:27.662130 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:45:27.663613 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:45:27.663613 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 18 11:45:27.663613 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 11:45:27.663613 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fc6ee0a-b135-42dc-9099-30672626af2e is not attached to volume 0a3c86e6-31af-4e02-bd73-76aeb83e8df1 Oct 18 11:45:27.663613 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:45:27.663613 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:45:27.663613 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:45:27.663613 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:45:27.663613 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:45:27.663613 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:45:27.663613 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:45:27.663613 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:45:27.663613 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fc6ee0a-b135-42dc-9099-30672626af2e is not attached to volume 0a3c86e6-31af-4e02-bd73-76aeb83e8df1 Oct 18 11:45:27.663613 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:45:27.663613 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-6a3538de-2393-4543-b7ab-564525d155d7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Returning 404 to user: Instance 0fc6ee0a-b135-42dc-9099-30672626af2e is not attached to volume 0a3c86e6-31af-4e02-bd73-76aeb83e8df1 {{(pid=125486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:45:27.664739 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-6a3538de-2393-4543-b7ab-564525d155d7 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e/os-volume_attachments/0a3c86e6-31af-4e02-bd73-76aeb83e8df1" status: 404 len: 154 microversion: 2.1 time: 0.108312 Oct 18 11:45:27.664739 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 321/664] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Oct 18 11:45:27 2022] DELETE /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e/os-volume_attachments/0a3c86e6-31af-4e02-bd73-76aeb83e8df1 => generated 154 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:45:28.218159 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-17ada107-1a6b-4d9e-96cf-505afb2de573 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:28.218782 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-17ada107-1a6b-4d9e-96cf-505afb2de573 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:28.226683 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-17ada107-1a6b-4d9e-96cf-505afb2de573 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:28.227456 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-17ada107-1a6b-4d9e-96cf-505afb2de573 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:28.227722 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-17ada107-1a6b-4d9e-96cf-505afb2de573 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:28.228464 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-17ada107-1a6b-4d9e-96cf-505afb2de573 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:28.228942 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-17ada107-1a6b-4d9e-96cf-505afb2de573 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:28.229556 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-17ada107-1a6b-4d9e-96cf-505afb2de573 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:28.265702 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-17ada107-1a6b-4d9e-96cf-505afb2de573 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:28.266202 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-17ada107-1a6b-4d9e-96cf-505afb2de573 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:28.266639 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-17ada107-1a6b-4d9e-96cf-505afb2de573 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:28.267171 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.objects.instance [None req-17ada107-1a6b-4d9e-96cf-505afb2de573 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lazy-loading 'fault' on Instance uuid 3f737271-603e-4448-b37d-4a5ae83dd052 {{(pid=125485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:45:28.313786 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-17ada107-1a6b-4d9e-96cf-505afb2de573 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:28.322219 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-17ada107-1a6b-4d9e-96cf-505afb2de573 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1335 microversion: 2.1 time: 0.107990 Oct 18 11:45:28.322807 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 344/665] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:28 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1335 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:28.830507 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-3c4fcf97-7561-42a0-ab88-564d19837f2a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:28.831033 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-3c4fcf97-7561-42a0-ab88-564d19837f2a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:28.837867 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3c4fcf97-7561-42a0-ab88-564d19837f2a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:28.838354 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3c4fcf97-7561-42a0-ab88-564d19837f2a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:28.838765 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3c4fcf97-7561-42a0-ab88-564d19837f2a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:28.839464 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3c4fcf97-7561-42a0-ab88-564d19837f2a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:28.839900 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3c4fcf97-7561-42a0-ab88-564d19837f2a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:28.840307 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3c4fcf97-7561-42a0-ab88-564d19837f2a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:28.866919 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-3c4fcf97-7561-42a0-ab88-564d19837f2a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Going to try to terminate instance {{(pid=125486) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 11:45:28.944680 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-3c4fcf97-7561-42a0-ab88-564d19837f2a tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 204 len: 0 microversion: 2.1 time: 0.117778 Oct 18 11:45:28.945296 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 322/666] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Oct 18 11:45:28 2022] DELETE /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 11:45:28.954105 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-3c136cdb-6e31-4a43-b22b-76adada7fa68 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:28.955837 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-3c136cdb-6e31-4a43-b22b-76adada7fa68 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:28.961673 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3c136cdb-6e31-4a43-b22b-76adada7fa68 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:28.962206 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3c136cdb-6e31-4a43-b22b-76adada7fa68 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:28.962647 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3c136cdb-6e31-4a43-b22b-76adada7fa68 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:28.963867 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3c136cdb-6e31-4a43-b22b-76adada7fa68 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:28.964346 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3c136cdb-6e31-4a43-b22b-76adada7fa68 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:28.964772 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3c136cdb-6e31-4a43-b22b-76adada7fa68 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:29.111406 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-3c136cdb-6e31-4a43-b22b-76adada7fa68 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:29.119618 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-3c136cdb-6e31-4a43-b22b-76adada7fa68 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1554 microversion: 2.1 time: 0.169570 Oct 18 11:45:29.120110 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 345/667] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:28 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:29.346748 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-aa849fc2-9a9c-470e-be49-0f4c2b14a9b1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:29.347494 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-aa849fc2-9a9c-470e-be49-0f4c2b14a9b1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:29.353874 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-aa849fc2-9a9c-470e-be49-0f4c2b14a9b1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:29.354348 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-aa849fc2-9a9c-470e-be49-0f4c2b14a9b1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:29.354809 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-aa849fc2-9a9c-470e-be49-0f4c2b14a9b1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:29.355486 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-aa849fc2-9a9c-470e-be49-0f4c2b14a9b1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:29.355926 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-aa849fc2-9a9c-470e-be49-0f4c2b14a9b1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:29.356338 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-aa849fc2-9a9c-470e-be49-0f4c2b14a9b1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:29.386992 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-aa849fc2-9a9c-470e-be49-0f4c2b14a9b1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:29.387371 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-aa849fc2-9a9c-470e-be49-0f4c2b14a9b1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:29.387852 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-aa849fc2-9a9c-470e-be49-0f4c2b14a9b1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:29.388365 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.objects.instance [None req-aa849fc2-9a9c-470e-be49-0f4c2b14a9b1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lazy-loading 'fault' on Instance uuid 3f737271-603e-4448-b37d-4a5ae83dd052 {{(pid=125486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:45:29.430769 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-aa849fc2-9a9c-470e-be49-0f4c2b14a9b1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:29.438511 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-aa849fc2-9a9c-470e-be49-0f4c2b14a9b1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1335 microversion: 2.1 time: 0.096128 Oct 18 11:45:29.439072 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 323/668] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:29 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1335 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:30.143507 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-c384ada5-b53c-4c15-affc-915b10b7f3ee tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:30.144057 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-c384ada5-b53c-4c15-affc-915b10b7f3ee tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:30.150640 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c384ada5-b53c-4c15-affc-915b10b7f3ee tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:30.151131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c384ada5-b53c-4c15-affc-915b10b7f3ee tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:30.151562 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c384ada5-b53c-4c15-affc-915b10b7f3ee tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:30.152282 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c384ada5-b53c-4c15-affc-915b10b7f3ee tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:30.152719 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c384ada5-b53c-4c15-affc-915b10b7f3ee tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:30.153283 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c384ada5-b53c-4c15-affc-915b10b7f3ee tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:30.287234 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-c384ada5-b53c-4c15-affc-915b10b7f3ee tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:30.295091 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-c384ada5-b53c-4c15-affc-915b10b7f3ee tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1554 microversion: 2.1 time: 0.155550 Oct 18 11:45:30.295669 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 346/669] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:30 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:30.462496 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-618fd5c7-37e7-4551-acd9-a82f4056baaa tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:30.463047 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-618fd5c7-37e7-4551-acd9-a82f4056baaa tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:30.469335 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-618fd5c7-37e7-4551-acd9-a82f4056baaa tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:30.469807 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-618fd5c7-37e7-4551-acd9-a82f4056baaa tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:30.470260 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-618fd5c7-37e7-4551-acd9-a82f4056baaa tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:30.470957 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-618fd5c7-37e7-4551-acd9-a82f4056baaa tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:30.471400 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-618fd5c7-37e7-4551-acd9-a82f4056baaa tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:30.471811 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-618fd5c7-37e7-4551-acd9-a82f4056baaa tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:30.502667 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-618fd5c7-37e7-4551-acd9-a82f4056baaa tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:30.503137 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-618fd5c7-37e7-4551-acd9-a82f4056baaa tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:30.503558 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-618fd5c7-37e7-4551-acd9-a82f4056baaa tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:30.504096 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.objects.instance [None req-618fd5c7-37e7-4551-acd9-a82f4056baaa tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lazy-loading 'fault' on Instance uuid 3f737271-603e-4448-b37d-4a5ae83dd052 {{(pid=125486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:45:30.544644 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-618fd5c7-37e7-4551-acd9-a82f4056baaa tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:30.552692 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-618fd5c7-37e7-4551-acd9-a82f4056baaa tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 200 len: 1335 microversion: 2.1 time: 0.094180 Oct 18 11:45:30.553279 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 324/670] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:30 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 1335 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:30.849234 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-7c39994c-594b-46e8-b1f9-650ca3fea68a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:30.849638 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-7c39994c-594b-46e8-b1f9-650ca3fea68a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:30.855893 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7c39994c-594b-46e8-b1f9-650ca3fea68a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:30.856451 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7c39994c-594b-46e8-b1f9-650ca3fea68a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:30.857017 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7c39994c-594b-46e8-b1f9-650ca3fea68a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:30.857772 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7c39994c-594b-46e8-b1f9-650ca3fea68a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:30.858262 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7c39994c-594b-46e8-b1f9-650ca3fea68a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:30.858951 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7c39994c-594b-46e8-b1f9-650ca3fea68a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:30.884715 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-7c39994c-594b-46e8-b1f9-650ca3fea68a tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a/ips" status: 200 len: 148 microversion: 2.1 time: 0.039916 Oct 18 11:45:30.885441 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 347/671] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Oct 18 11:45:30 2022] GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:45:31.324723 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-78649f5a-7db3-4afa-b89e-2e7560c2b9ed tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:31.325483 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-78649f5a-7db3-4afa-b89e-2e7560c2b9ed tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:31.332014 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-78649f5a-7db3-4afa-b89e-2e7560c2b9ed tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:31.332652 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-78649f5a-7db3-4afa-b89e-2e7560c2b9ed tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:31.333120 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-78649f5a-7db3-4afa-b89e-2e7560c2b9ed tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:31.333821 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-78649f5a-7db3-4afa-b89e-2e7560c2b9ed tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:31.334272 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-78649f5a-7db3-4afa-b89e-2e7560c2b9ed tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:31.334759 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-78649f5a-7db3-4afa-b89e-2e7560c2b9ed tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:31.445859 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-78649f5a-7db3-4afa-b89e-2e7560c2b9ed tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fed14900304dc99c4c1d5fdfe204af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f8bd1dce742b09e413947db416e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:31.453867 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-78649f5a-7db3-4afa-b89e-2e7560c2b9ed tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 200 len: 1512 microversion: 2.1 time: 0.133008 Oct 18 11:45:31.454437 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 325/672] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:31 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 1512 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:31.481458 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-5ff266ad-1a92-4ba5-88a2-658e351ba363 req-f92ee41c-a717-492a-af72-6717721c9bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fc6ee0a-b135-42dc-9099-30672626af2e", "name": "network-vif-deleted", "tag": "dad12b9b-8fc3-457f-a59d-d7e7760984cc"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:45:31.492067 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-5ff266ad-1a92-4ba5-88a2-658e351ba363 req-f92ee41c-a717-492a-af72-6717721c9bb7 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:31.492543 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-5ff266ad-1a92-4ba5-88a2-658e351ba363 req-f92ee41c-a717-492a-af72-6717721c9bb7 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:31.492998 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-5ff266ad-1a92-4ba5-88a2-658e351ba363 req-f92ee41c-a717-492a-af72-6717721c9bb7 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:31.504658 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-5ff266ad-1a92-4ba5-88a2-658e351ba363 req-f92ee41c-a717-492a-af72-6717721c9bb7 service nova] Creating event network-vif-deleted:dad12b9b-8fc3-457f-a59d-d7e7760984cc for instance 0fc6ee0a-b135-42dc-9099-30672626af2e on hv-cinder-81558 Oct 18 11:45:31.509360 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-5ff266ad-1a92-4ba5-88a2-658e351ba363 req-f92ee41c-a717-492a-af72-6717721c9bb7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032228 Oct 18 11:45:31.509949 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 348/673] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:45:31.575719 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-fc0afbb6-8525-42b0-865d-add27e881c9d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:31.576300 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-fc0afbb6-8525-42b0-865d-add27e881c9d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 3f737271-603e-4448-b37d-4a5ae83dd052] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:31.583120 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fc0afbb6-8525-42b0-865d-add27e881c9d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:31.583606 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fc0afbb6-8525-42b0-865d-add27e881c9d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:31.584037 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fc0afbb6-8525-42b0-865d-add27e881c9d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:31.584728 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fc0afbb6-8525-42b0-865d-add27e881c9d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:31.585208 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fc0afbb6-8525-42b0-865d-add27e881c9d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:31.585627 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fc0afbb6-8525-42b0-865d-add27e881c9d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:31.601086 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.wsgi [None req-fc0afbb6-8525-42b0-865d-add27e881c9d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] HTTP exception thrown: Instance 3f737271-603e-4448-b37d-4a5ae83dd052 could not be found. Oct 18 11:45:31.602360 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-fc0afbb6-8525-42b0-865d-add27e881c9d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Request method failure captured: Oct 18 11:45:31.602360 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: request: GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 HTTP/1.1 Oct 18 11:45:31.602360 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept: application/json Oct 18 11:45:31.602360 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept-Encoding: identity Oct 18 11:45:31.602360 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Connection: close Oct 18 11:45:31.602360 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Length: 0 Oct 18 11:45:31.602360 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Type: application/json Oct 18 11:45:31.602360 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Host: 10.222.0.17 Oct 18 11:45:31.602360 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Openstack-System-Scope: None Oct 18 11:45:31.602360 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: User-Agent: python-urllib3/1.26.12 Oct 18 11:45:31.602360 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Auth-Token: gAAAAABjTpCyITCOuZ_3FbMTs3DhKEW_OwwcrGod2a_lrP_UNCZrETSVqjf-o7Z_Za1EvdYUbGePPsNMV1lYEK1fAp16Ng8WUSaI3Prsxzq9uX4zhASpgMp9MLYGWUxlDXz9kmC1mhrxhXDkhFi9KB2Jd7SlJFgu7FNGvZ6QYPd5pDBE_uJGE7M Oct 18 11:45:31.602360 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Id: None Oct 18 11:45:31.602360 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Name: None Oct 18 11:45:31.602360 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Identity-Status: Confirmed Oct 18 11:45:31.602360 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Is-Admin-Project: True Oct 18 11:45:31.602360 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Id: default Oct 18 11:45:31.602360 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Name: Default Oct 18 11:45:31.602360 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Id: cd52252f24114465af9bdf6e6fe68b76 Oct 18 11:45:31.602360 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1678509525 Oct 18 11:45:31.602360 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Role: reader,member Oct 18 11:45:31.602360 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Roles: reader,member Oct 18 11:45:31.604076 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd52252f24114465af9bdf6e6fe68b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cd52252f24114465af9bdf6e6fe68b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cd52252f24114465af9bdf6e6fe68b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd52252f24114465af9bdf6e6fe68b76"}]}] Oct 18 11:45:31.604076 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1678509525 Oct 18 11:45:31.604076 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Id: cd52252f24114465af9bdf6e6fe68b76 Oct 18 11:45:31.604076 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1678509525 Oct 18 11:45:31.604076 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User: tempest-ServerRescueNegativeTestJSON-1678509525-project Oct 18 11:45:31.604076 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Id: default Oct 18 11:45:31.604076 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Name: Default Oct 18 11:45:31.604076 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Id: 1f624c36a3574b61bd17d5d73af71916 Oct 18 11:45:31.604076 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1678509525-project Oct 18 11:45:31.604076 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: method: > Oct 18 11:45:31.604076 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: exception: Instance 3f737271-603e-4448-b37d-4a5ae83dd052 could not be found. Oct 18 11:45:31.604076 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: action_args: {'id': '3f737271-603e-4448-b37d-4a5ae83dd052'} Oct 18 11:45:31.604877 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:45:31.604877 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:45:31.604877 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:45:31.604877 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:45:31.604877 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:45:31.604877 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:45:31.604877 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:45:31.604877 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:45:31.604877 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:45:31.604877 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:45:31.604877 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f737271-603e-4448-b37d-4a5ae83dd052 could not be found. Oct 18 11:45:31.604877 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:45:31.604877 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:45:31.604877 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:45:31.604877 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:45:31.604877 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:45:31.604877 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:45:31.604877 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:45:31.604877 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:45:31.604877 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:45:31.606110 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:45:31.606110 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 11:45:31.606110 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 11:45:31.606110 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:45:31.606110 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:45:31.606110 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:45:31.606110 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:45:31.606110 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f737271-603e-4448-b37d-4a5ae83dd052 could not be found. Oct 18 11:45:31.606110 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:45:31.606110 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:45:31.606110 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:45:31.606110 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:45:31.606110 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:45:31.606110 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:45:31.606110 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:45:31.606110 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:45:31.606110 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f737271-603e-4448-b37d-4a5ae83dd052 could not be found. Oct 18 11:45:31.606110 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:45:31.607218 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-fc0afbb6-8525-42b0-865d-add27e881c9d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Returning 404 to user: Instance 3f737271-603e-4448-b37d-4a5ae83dd052 could not be found. {{(pid=125486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:45:31.607218 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-fc0afbb6-8525-42b0-865d-add27e881c9d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052" status: 404 len: 111 microversion: 2.1 time: 0.032137 Oct 18 11:45:31.607218 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 326/674] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:31 2022] GET /compute/v2.1/servers/3f737271-603e-4448-b37d-4a5ae83dd052 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:45:31.612738 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-a048ea1f-3c12-4b7f-b70a-ce7e5dd23bbc tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '.version_select at 0x7f4bdbe90550>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:31.620438 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:45:31.634204 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-a048ea1f-3c12-4b7f-b70a-ce7e5dd23bbc tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1370828389" status: 202 len: 0 microversion: 2.1 time: 0.025466 Oct 18 11:45:31.634785 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 349/675] 10.222.0.17 () {58 vars in 1221 bytes} [Tue Oct 18 11:45:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1370828389 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 11:45:32.286137 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-812c71c4-522b-4bfb-bea1-7ec37d7f9632 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92013fbb-c355-4def-a8d4-5ac77dff3c0a"}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:45:32.288809 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-812c71c4-522b-4bfb-bea1-7ec37d7f9632 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:32.294852 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-812c71c4-522b-4bfb-bea1-7ec37d7f9632 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:32.295343 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-812c71c4-522b-4bfb-bea1-7ec37d7f9632 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:32.295850 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-812c71c4-522b-4bfb-bea1-7ec37d7f9632 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:32.296536 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-812c71c4-522b-4bfb-bea1-7ec37d7f9632 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:32.297056 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-812c71c4-522b-4bfb-bea1-7ec37d7f9632 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:32.297484 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-812c71c4-522b-4bfb-bea1-7ec37d7f9632 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:32.478785 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-dcfe4022-701d-4073-9ef9-85b27a0ba69b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:32.480058 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-dcfe4022-701d-4073-9ef9-85b27a0ba69b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] [instance: 0fc6ee0a-b135-42dc-9099-30672626af2e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:32.486329 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-dcfe4022-701d-4073-9ef9-85b27a0ba69b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:32.486907 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-dcfe4022-701d-4073-9ef9-85b27a0ba69b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:32.487325 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-dcfe4022-701d-4073-9ef9-85b27a0ba69b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:32.488010 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-dcfe4022-701d-4073-9ef9-85b27a0ba69b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:32.488453 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-dcfe4022-701d-4073-9ef9-85b27a0ba69b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:32.489688 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-dcfe4022-701d-4073-9ef9-85b27a0ba69b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:32.505871 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.wsgi [None req-dcfe4022-701d-4073-9ef9-85b27a0ba69b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] HTTP exception thrown: Instance 0fc6ee0a-b135-42dc-9099-30672626af2e could not be found. Oct 18 11:45:32.507574 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-dcfe4022-701d-4073-9ef9-85b27a0ba69b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Request method failure captured: Oct 18 11:45:32.507574 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e HTTP/1.1 Oct 18 11:45:32.507574 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:45:32.507574 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:45:32.507574 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:45:32.507574 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 0 Oct 18 11:45:32.507574 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:45:32.507574 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:45:32.507574 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:45:32.507574 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:45:32.507574 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpETnxdqUxIfICUxCd1yIP2CWgkGb-Kw8BxAjibtqYc2_VZRex-LOCP94hRgfcowI2bdFUkx6Cj8RrdUaVl8f0agX2ajKKcs4BEes9X-HlwG9MPNSrKHcIriQzsMX4rZhC9kOAXDAZsi3eDn8LAlS_DhWjYKVYrT3L5MnZRdF1hu9b4 Oct 18 11:45:32.507574 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:45:32.507574 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:45:32.507574 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:45:32.507574 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:45:32.507574 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:45:32.507574 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:45:32.507574 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: b63f8bd1dce742b09e413947db416e66 Oct 18 11:45:32.507574 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-TestMinimumBasicScenario-1767014436 Oct 18 11:45:32.507574 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:45:32.507574 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:45:32.509249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b63f8bd1dce742b09e413947db416e66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b63f8bd1dce742b09e413947db416e66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b63f8bd1dce742b09e413947db416e66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b63f8bd1dce742b09e413947db416e66"}]}] Oct 18 11:45:32.509249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-TestMinimumBasicScenario-1767014436 Oct 18 11:45:32.509249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: b63f8bd1dce742b09e413947db416e66 Oct 18 11:45:32.509249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1767014436 Oct 18 11:45:32.509249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-TestMinimumBasicScenario-1767014436-project Oct 18 11:45:32.509249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:45:32.509249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:45:32.509249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: b9fed14900304dc99c4c1d5fdfe204af Oct 18 11:45:32.509249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-TestMinimumBasicScenario-1767014436-project Oct 18 11:45:32.509249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: > Oct 18 11:45:32.509249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Instance 0fc6ee0a-b135-42dc-9099-30672626af2e could not be found. Oct 18 11:45:32.509249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'id': '0fc6ee0a-b135-42dc-9099-30672626af2e'} Oct 18 11:45:32.510040 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:45:32.510040 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:45:32.510040 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:45:32.510040 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:45:32.510040 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:45:32.510040 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:45:32.510040 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:45:32.510040 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:45:32.510040 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:45:32.510040 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:45:32.510040 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fc6ee0a-b135-42dc-9099-30672626af2e could not be found. Oct 18 11:45:32.510040 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:45:32.510040 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:45:32.510040 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:45:32.510040 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:45:32.510040 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:45:32.510040 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:45:32.510040 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:45:32.510040 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:45:32.510040 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:45:32.511532 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:45:32.511532 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 11:45:32.511532 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 11:45:32.511532 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:45:32.511532 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:45:32.511532 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:45:32.511532 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:45:32.511532 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fc6ee0a-b135-42dc-9099-30672626af2e could not be found. Oct 18 11:45:32.511532 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:45:32.511532 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:45:32.511532 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:45:32.511532 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:45:32.511532 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:45:32.511532 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:45:32.511532 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:45:32.511532 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:45:32.511532 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fc6ee0a-b135-42dc-9099-30672626af2e could not be found. Oct 18 11:45:32.511532 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:45:32.513498 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-dcfe4022-701d-4073-9ef9-85b27a0ba69b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Returning 404 to user: Instance 0fc6ee0a-b135-42dc-9099-30672626af2e could not be found. {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:45:32.513498 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-dcfe4022-701d-4073-9ef9-85b27a0ba69b tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e" status: 404 len: 111 microversion: 2.1 time: 0.034590 Oct 18 11:45:32.513498 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 350/676] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:32 2022] GET /compute/v2.1/servers/0fc6ee0a-b135-42dc-9099-30672626af2e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 11:45:32.517750 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-604cba86-a5f2-4285-be32-ffbce854e968 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] Calling method '.version_select at 0x7f4be002ff70>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:32.539213 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-604cba86-a5f2-4285-be32-ffbce854e968 tempest-TestMinimumBasicScenario-1767014436 tempest-TestMinimumBasicScenario-1767014436-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1609336397" status: 202 len: 0 microversion: 2.1 time: 0.025082 Oct 18 11:45:32.539832 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 351/677] 10.222.0.17 () {58 vars in 1272 bytes} [Tue Oct 18 11:45:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1609336397 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 11:45:32.557327 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-812c71c4-522b-4bfb-bea1-7ec37d7f9632 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "POST /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275727 Oct 18 11:45:32.557923 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 327/678] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Oct 18 11:45:32 2022] POST /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:45:34.544400 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-447d9271-9816-4367-a43a-5a37257a727c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:34.545248 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-447d9271-9816-4367-a43a-5a37257a727c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:34.556639 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-447d9271-9816-4367-a43a-5a37257a727c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:34.558139 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-447d9271-9816-4367-a43a-5a37257a727c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:34.558769 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-447d9271-9816-4367-a43a-5a37257a727c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:34.559856 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-447d9271-9816-4367-a43a-5a37257a727c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:34.560487 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-447d9271-9816-4367-a43a-5a37257a727c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:34.560969 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-447d9271-9816-4367-a43a-5a37257a727c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:34.601340 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-447d9271-9816-4367-a43a-5a37257a727c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Going to try to terminate instance {{(pid=125485) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 11:45:34.616757 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:45:34.715682 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-447d9271-9816-4367-a43a-5a37257a727c tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 204 len: 0 microversion: 2.1 time: 0.177813 Oct 18 11:45:34.717044 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 352/679] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Oct 18 11:45:34 2022] DELETE /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 11:45:34.725320 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-d5e6d01b-175b-4176-bb90-a859d9a5797f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:34.726030 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-d5e6d01b-175b-4176-bb90-a859d9a5797f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:34.738319 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d5e6d01b-175b-4176-bb90-a859d9a5797f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:34.738851 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d5e6d01b-175b-4176-bb90-a859d9a5797f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:34.740242 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d5e6d01b-175b-4176-bb90-a859d9a5797f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:34.741367 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d5e6d01b-175b-4176-bb90-a859d9a5797f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:34.741997 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d5e6d01b-175b-4176-bb90-a859d9a5797f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:34.742594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d5e6d01b-175b-4176-bb90-a859d9a5797f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:35.009853 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-d5e6d01b-175b-4176-bb90-a859d9a5797f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:35.023066 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-d5e6d01b-175b-4176-bb90-a859d9a5797f tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1508 microversion: 2.1 time: 0.298737 Oct 18 11:45:35.024408 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 328/680] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:34 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1508 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:36.124206 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-203d66f0-177d-40e2-95ce-26de6fb60b8b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:36.124948 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-203d66f0-177d-40e2-95ce-26de6fb60b8b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:36.136629 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-203d66f0-177d-40e2-95ce-26de6fb60b8b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:36.137287 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-203d66f0-177d-40e2-95ce-26de6fb60b8b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:36.137731 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-203d66f0-177d-40e2-95ce-26de6fb60b8b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:36.138429 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-203d66f0-177d-40e2-95ce-26de6fb60b8b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:36.139059 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-203d66f0-177d-40e2-95ce-26de6fb60b8b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:36.139476 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-203d66f0-177d-40e2-95ce-26de6fb60b8b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:36.308044 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-203d66f0-177d-40e2-95ce-26de6fb60b8b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:36.315954 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-203d66f0-177d-40e2-95ce-26de6fb60b8b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1508 microversion: 2.1 time: 0.269004 Oct 18 11:45:36.328813 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 353/681] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:36 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1508 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:37.339766 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-3c8a8790-fc30-4516-926f-3861bc50f04b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:37.340381 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-3c8a8790-fc30-4516-926f-3861bc50f04b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:37.347007 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3c8a8790-fc30-4516-926f-3861bc50f04b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:37.347496 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3c8a8790-fc30-4516-926f-3861bc50f04b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:37.348516 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3c8a8790-fc30-4516-926f-3861bc50f04b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:37.349483 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3c8a8790-fc30-4516-926f-3861bc50f04b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:37.349947 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3c8a8790-fc30-4516-926f-3861bc50f04b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:37.350370 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3c8a8790-fc30-4516-926f-3861bc50f04b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:37.602003 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-3c8a8790-fc30-4516-926f-3861bc50f04b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:37.610847 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-3c8a8790-fc30-4516-926f-3861bc50f04b tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1508 microversion: 2.1 time: 0.274968 Oct 18 11:45:37.612029 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 329/682] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:37 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1508 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:38.069527 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-8fd730bb-5d1e-4d3f-8fc9-20f11a87b22f req-6804321a-2fb8-47eb-86de-7d47291e45b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ede7abe-e470-4b36-83ed-cd28e0347ac8", "name": "network-vif-deleted", "tag": "f8af432d-f3da-4a10-a4cd-7e455ecc405c"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:45:38.105013 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-8fd730bb-5d1e-4d3f-8fc9-20f11a87b22f req-6804321a-2fb8-47eb-86de-7d47291e45b4 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:38.106229 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-8fd730bb-5d1e-4d3f-8fc9-20f11a87b22f req-6804321a-2fb8-47eb-86de-7d47291e45b4 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:38.107857 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-8fd730bb-5d1e-4d3f-8fc9-20f11a87b22f req-6804321a-2fb8-47eb-86de-7d47291e45b4 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:38.135894 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-8fd730bb-5d1e-4d3f-8fc9-20f11a87b22f req-6804321a-2fb8-47eb-86de-7d47291e45b4 service nova] Creating event network-vif-deleted:f8af432d-f3da-4a10-a4cd-7e455ecc405c for instance 4ede7abe-e470-4b36-83ed-cd28e0347ac8 on hv-cinder-81558 Oct 18 11:45:38.145761 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-8fd730bb-5d1e-4d3f-8fc9-20f11a87b22f req-6804321a-2fb8-47eb-86de-7d47291e45b4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081447 Oct 18 11:45:38.153822 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 354/683] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:45:38.638433 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-d0a3aab1-371a-4467-a048-ce56e3e8830d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:38.640471 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-d0a3aab1-371a-4467-a048-ce56e3e8830d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:38.649907 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:45:38.652793 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d0a3aab1-371a-4467-a048-ce56e3e8830d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:38.654262 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d0a3aab1-371a-4467-a048-ce56e3e8830d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:38.654866 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d0a3aab1-371a-4467-a048-ce56e3e8830d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:38.655733 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d0a3aab1-371a-4467-a048-ce56e3e8830d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:38.656567 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d0a3aab1-371a-4467-a048-ce56e3e8830d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:38.657428 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d0a3aab1-371a-4467-a048-ce56e3e8830d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:38.708549 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d0a3aab1-371a-4467-a048-ce56e3e8830d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:38.709081 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d0a3aab1-371a-4467-a048-ce56e3e8830d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:38.709677 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d0a3aab1-371a-4467-a048-ce56e3e8830d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:38.710274 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.objects.instance [None req-d0a3aab1-371a-4467-a048-ce56e3e8830d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lazy-loading 'fault' on Instance uuid 4ede7abe-e470-4b36-83ed-cd28e0347ac8 {{(pid=125486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:45:38.757037 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-d0a3aab1-371a-4467-a048-ce56e3e8830d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:38.760722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:45:38.770081 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-d0a3aab1-371a-4467-a048-ce56e3e8830d tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 200 len: 1311 microversion: 2.1 time: 0.138884 Oct 18 11:45:38.771220 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 330/684] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:38 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 1311 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:39.353067 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-99a7c133-6a2c-4f2a-a518-6d67b6b33e2b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92013fbb-c355-4def-a8d4-5ac77dff3c0a"}} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:45:39.355888 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-99a7c133-6a2c-4f2a-a518-6d67b6b33e2b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:39.362412 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-99a7c133-6a2c-4f2a-a518-6d67b6b33e2b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:39.363160 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-99a7c133-6a2c-4f2a-a518-6d67b6b33e2b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:39.363802 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-99a7c133-6a2c-4f2a-a518-6d67b6b33e2b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:39.366636 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-99a7c133-6a2c-4f2a-a518-6d67b6b33e2b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:39.367283 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-99a7c133-6a2c-4f2a-a518-6d67b6b33e2b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:39.367986 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-99a7c133-6a2c-4f2a-a518-6d67b6b33e2b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:39.492388 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.wsgi [None req-99a7c133-6a2c-4f2a-a518-6d67b6b33e2b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] HTTP exception thrown: Invalid volume: volume 92013fbb-c355-4def-a8d4-5ac77dff3c0a is already attached to instances: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a Oct 18 11:45:39.494298 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-99a7c133-6a2c-4f2a-a518-6d67b6b33e2b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Request method failure captured: Oct 18 11:45:39.494298 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: POST /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a/os-volume_attachments HTTP/1.1 Oct 18 11:45:39.494298 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:45:39.494298 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:45:39.494298 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:45:39.494298 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 74 Oct 18 11:45:39.494298 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:45:39.494298 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:45:39.494298 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:45:39.494298 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:45:39.494298 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpC0QX2SvHowI5-vz58GDwpVMERgGiI-pqt2GQ4o1fdQFbeIrfuLVtcw55IWYTDh91fNo1KVKFcag_YfGjslSHmWVAe8eH9iiMTcKmdOtt4MUEPPWZ9OQcF5wlXB0WJP-XHDUtk0mAsVICaitUhEDH7cqfrNMho4FbOB0yKZgk6M4Ns Oct 18 11:45:39.494298 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:45:39.494298 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:45:39.494298 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:45:39.494298 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:45:39.494298 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:45:39.494298 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:45:39.494298 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: 633afaabbbff47a4a99ebc997e67b01a Oct 18 11:45:39.494298 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:45:39.494298 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:45:39.494298 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:45:39.495810 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/633afaabbbff47a4a99ebc997e67b01a"}]}] Oct 18 11:45:39.495810 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:45:39.495810 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: 633afaabbbff47a4a99ebc997e67b01a Oct 18 11:45:39.495810 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:45:39.495810 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-AttachVolumeNegativeTest-1091652349-project Oct 18 11:45:39.495810 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:45:39.495810 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:45:39.495810 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: 916699a212eb4d8aa945f299ac0d4c96 Oct 18 11:45:39.495810 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-AttachVolumeNegativeTest-1091652349-project Oct 18 11:45:39.495810 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Oct 18 11:45:39.495810 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {"volumeAttachment": {"volumeId": "92013fbb-c355-4def-a8d4-5ac77dff3c0a"}} Oct 18 11:45:39.495810 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: > Oct 18 11:45:39.496754 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Invalid volume: volume 92013fbb-c355-4def-a8d4-5ac77dff3c0a is already attached to instances: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a Oct 18 11:45:39.496754 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'server_id': '8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a', 'body': {'volumeAttachment': {'volumeId': '92013fbb-c355-4def-a8d4-5ac77dff3c0a'}}} Oct 18 11:45:39.496754 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:45:39.496754 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:45:39.496754 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 18 11:45:39.496754 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 18 11:45:39.496754 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 11:45:39.496754 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 11:45:39.496754 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 18 11:45:39.496754 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 11:45:39.496754 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 18 11:45:39.496754 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 18 11:45:39.496754 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 18 11:45:39.496754 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 18 11:45:39.496754 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 92013fbb-c355-4def-a8d4-5ac77dff3c0a is already attached to instances: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a Oct 18 11:45:39.496754 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:45:39.496754 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:45:39.496754 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:45:39.496754 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:45:39.498080 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:45:39.498080 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:45:39.498080 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:45:39.498080 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:45:39.498080 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:45:39.498080 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:45:39.498080 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 11:45:39.498080 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 11:45:39.498080 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 11:45:39.498080 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 11:45:39.498080 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 11:45:39.498080 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 11:45:39.498080 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 18 11:45:39.498080 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 18 11:45:39.498080 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 92013fbb-c355-4def-a8d4-5ac77dff3c0a is already attached to instances: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a Oct 18 11:45:39.498080 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:45:39.498080 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:45:39.498080 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:45:39.498080 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:45:39.498080 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:45:39.499458 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:45:39.499458 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:45:39.499458 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:45:39.499458 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 92013fbb-c355-4def-a8d4-5ac77dff3c0a is already attached to instances: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a Oct 18 11:45:39.499458 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:45:39.502092 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-99a7c133-6a2c-4f2a-a518-6d67b6b33e2b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Returning 400 to user: Invalid volume: volume 92013fbb-c355-4def-a8d4-5ac77dff3c0a is already attached to instances: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:45:39.503475 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-99a7c133-6a2c-4f2a-a518-6d67b6b33e2b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "POST /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.157068 Oct 18 11:45:39.504567 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 355/685] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Oct 18 11:45:39 2022] POST /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a/os-volume_attachments => generated 174 bytes in 159 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 11:45:39.583095 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-9bfeea31-2ce3-4192-8acc-eb8e45963612 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:39.584021 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-9bfeea31-2ce3-4192-8acc-eb8e45963612 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:39.591515 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9bfeea31-2ce3-4192-8acc-eb8e45963612 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:39.592392 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9bfeea31-2ce3-4192-8acc-eb8e45963612 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:39.592929 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9bfeea31-2ce3-4192-8acc-eb8e45963612 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:39.593719 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9bfeea31-2ce3-4192-8acc-eb8e45963612 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:39.594431 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9bfeea31-2ce3-4192-8acc-eb8e45963612 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:39.595112 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9bfeea31-2ce3-4192-8acc-eb8e45963612 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:39.719786 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.objects.instance [None req-9bfeea31-2ce3-4192-8acc-eb8e45963612 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lazy-loading 'services' on Instance uuid 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a {{(pid=125486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:45:39.795879 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-e8630d80-415c-4d9e-bc64-4213718e11fb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:39.797297 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-e8630d80-415c-4d9e-bc64-4213718e11fb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 4ede7abe-e470-4b36-83ed-cd28e0347ac8] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:39.815052 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-9bfeea31-2ce3-4192-8acc-eb8e45963612 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a/os-volume_attachments/92013fbb-c355-4def-a8d4-5ac77dff3c0a" status: 202 len: 0 microversion: 2.1 time: 0.239304 Oct 18 11:45:39.816235 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 331/686] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Oct 18 11:45:39 2022] DELETE /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a/os-volume_attachments/92013fbb-c355-4def-a8d4-5ac77dff3c0a => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 11:45:39.832647 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-94411a0e-3a79-4c0d-b290-113b03fb2e81 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:39.835115 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-94411a0e-3a79-4c0d-b290-113b03fb2e81 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:39.844035 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e8630d80-415c-4d9e-bc64-4213718e11fb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:39.845588 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e8630d80-415c-4d9e-bc64-4213718e11fb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:39.846396 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e8630d80-415c-4d9e-bc64-4213718e11fb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:39.849095 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-94411a0e-3a79-4c0d-b290-113b03fb2e81 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:39.850695 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-94411a0e-3a79-4c0d-b290-113b03fb2e81 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:39.851255 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e8630d80-415c-4d9e-bc64-4213718e11fb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:39.851745 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e8630d80-415c-4d9e-bc64-4213718e11fb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:39.851881 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-94411a0e-3a79-4c0d-b290-113b03fb2e81 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:39.852665 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e8630d80-415c-4d9e-bc64-4213718e11fb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:39.852794 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-94411a0e-3a79-4c0d-b290-113b03fb2e81 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:39.854065 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-94411a0e-3a79-4c0d-b290-113b03fb2e81 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:39.854621 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-94411a0e-3a79-4c0d-b290-113b03fb2e81 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:39.884054 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.wsgi [None req-e8630d80-415c-4d9e-bc64-4213718e11fb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] HTTP exception thrown: Instance 4ede7abe-e470-4b36-83ed-cd28e0347ac8 could not be found. Oct 18 11:45:39.886263 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-e8630d80-415c-4d9e-bc64-4213718e11fb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Request method failure captured: Oct 18 11:45:39.886263 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 HTTP/1.1 Oct 18 11:45:39.886263 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:45:39.886263 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:45:39.886263 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:45:39.886263 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 0 Oct 18 11:45:39.886263 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:45:39.886263 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:45:39.886263 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:45:39.886263 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:45:39.886263 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpCyITCOuZ_3FbMTs3DhKEW_OwwcrGod2a_lrP_UNCZrETSVqjf-o7Z_Za1EvdYUbGePPsNMV1lYEK1fAp16Ng8WUSaI3Prsxzq9uX4zhASpgMp9MLYGWUxlDXz9kmC1mhrxhXDkhFi9KB2Jd7SlJFgu7FNGvZ6QYPd5pDBE_uJGE7M Oct 18 11:45:39.886263 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:45:39.886263 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:45:39.886263 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:45:39.886263 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:45:39.886263 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:45:39.886263 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:45:39.886263 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: cd52252f24114465af9bdf6e6fe68b76 Oct 18 11:45:39.886263 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1678509525 Oct 18 11:45:39.886263 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:45:39.886263 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:45:39.888086 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd52252f24114465af9bdf6e6fe68b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cd52252f24114465af9bdf6e6fe68b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cd52252f24114465af9bdf6e6fe68b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd52252f24114465af9bdf6e6fe68b76"}]}] Oct 18 11:45:39.888086 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1678509525 Oct 18 11:45:39.888086 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: cd52252f24114465af9bdf6e6fe68b76 Oct 18 11:45:39.888086 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1678509525 Oct 18 11:45:39.888086 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-ServerRescueNegativeTestJSON-1678509525-project Oct 18 11:45:39.888086 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:45:39.888086 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:45:39.888086 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: 1f624c36a3574b61bd17d5d73af71916 Oct 18 11:45:39.888086 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1678509525-project Oct 18 11:45:39.888086 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: > Oct 18 11:45:39.888086 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Instance 4ede7abe-e470-4b36-83ed-cd28e0347ac8 could not be found. Oct 18 11:45:39.888086 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'id': '4ede7abe-e470-4b36-83ed-cd28e0347ac8'} Oct 18 11:45:39.889280 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:45:39.889280 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:45:39.889280 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:45:39.889280 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:45:39.889280 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:45:39.889280 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:45:39.889280 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:45:39.889280 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:45:39.889280 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:45:39.889280 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:45:39.889280 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ede7abe-e470-4b36-83ed-cd28e0347ac8 could not be found. Oct 18 11:45:39.889280 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:45:39.889280 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:45:39.889280 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:45:39.889280 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:45:39.889280 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:45:39.889280 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:45:39.889280 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:45:39.889280 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:45:39.889280 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:45:39.890713 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:45:39.890713 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 11:45:39.890713 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 11:45:39.890713 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:45:39.890713 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:45:39.890713 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:45:39.890713 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:45:39.890713 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ede7abe-e470-4b36-83ed-cd28e0347ac8 could not be found. Oct 18 11:45:39.890713 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:45:39.890713 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:45:39.890713 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:45:39.890713 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:45:39.890713 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:45:39.890713 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:45:39.890713 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:45:39.890713 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:45:39.890713 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ede7abe-e470-4b36-83ed-cd28e0347ac8 could not be found. Oct 18 11:45:39.890713 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:45:39.891970 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-e8630d80-415c-4d9e-bc64-4213718e11fb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Returning 404 to user: Instance 4ede7abe-e470-4b36-83ed-cd28e0347ac8 could not be found. {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:45:39.891970 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-e8630d80-415c-4d9e-bc64-4213718e11fb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8" status: 404 len: 111 microversion: 2.1 time: 0.096043 Oct 18 11:45:39.891970 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 356/687] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:39 2022] GET /compute/v2.1/servers/4ede7abe-e470-4b36-83ed-cd28e0347ac8 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:45:39.901531 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-617feaf0-bb78-4bee-90b8-43ccaab0bdab tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:39.902139 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-617feaf0-bb78-4bee-90b8-43ccaab0bdab tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:39.912050 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-617feaf0-bb78-4bee-90b8-43ccaab0bdab tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:39.916073 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-617feaf0-bb78-4bee-90b8-43ccaab0bdab tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:39.917023 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-617feaf0-bb78-4bee-90b8-43ccaab0bdab tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:39.917950 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-617feaf0-bb78-4bee-90b8-43ccaab0bdab tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:39.919599 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-617feaf0-bb78-4bee-90b8-43ccaab0bdab tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:39.920147 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-617feaf0-bb78-4bee-90b8-43ccaab0bdab tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:39.937042 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-94411a0e-3a79-4c0d-b290-113b03fb2e81 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109542 Oct 18 11:45:39.941230 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 332/688] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Oct 18 11:45:39 2022] GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:45:39.952799 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-617feaf0-bb78-4bee-90b8-43ccaab0bdab tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Going to try to terminate instance {{(pid=125485) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 11:45:40.053402 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-617feaf0-bb78-4bee-90b8-43ccaab0bdab tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "DELETE /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b" status: 204 len: 0 microversion: 2.1 time: 0.155467 Oct 18 11:45:40.054383 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 357/689] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Oct 18 11:45:39 2022] DELETE /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 11:45:40.062315 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-48a91ef8-0c14-441e-8ef9-b52b5326d5f9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:40.063214 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-48a91ef8-0c14-441e-8ef9-b52b5326d5f9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:40.081599 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-48a91ef8-0c14-441e-8ef9-b52b5326d5f9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:40.082882 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-48a91ef8-0c14-441e-8ef9-b52b5326d5f9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:40.084143 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-48a91ef8-0c14-441e-8ef9-b52b5326d5f9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:40.085017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-48a91ef8-0c14-441e-8ef9-b52b5326d5f9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:40.085676 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-48a91ef8-0c14-441e-8ef9-b52b5326d5f9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:40.086078 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-48a91ef8-0c14-441e-8ef9-b52b5326d5f9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:40.341333 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-48a91ef8-0c14-441e-8ef9-b52b5326d5f9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:40.354574 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-48a91ef8-0c14-441e-8ef9-b52b5326d5f9 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b" status: 200 len: 1522 microversion: 2.1 time: 0.295460 Oct 18 11:45:40.355239 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 333/690] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:40 2022] GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:40.951346 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-271f3a9b-4e6d-42bf-a3f4-185f1b911625 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:40.953588 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-271f3a9b-4e6d-42bf-a3f4-185f1b911625 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:40.960207 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-271f3a9b-4e6d-42bf-a3f4-185f1b911625 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:40.960677 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-271f3a9b-4e6d-42bf-a3f4-185f1b911625 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:40.961129 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-271f3a9b-4e6d-42bf-a3f4-185f1b911625 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:40.961808 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-271f3a9b-4e6d-42bf-a3f4-185f1b911625 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:40.962249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-271f3a9b-4e6d-42bf-a3f4-185f1b911625 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:40.962687 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-271f3a9b-4e6d-42bf-a3f4-185f1b911625 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:40.992873 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-271f3a9b-4e6d-42bf-a3f4-185f1b911625 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045841 Oct 18 11:45:40.993432 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 358/691] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Oct 18 11:45:40 2022] GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:45:41.379487 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-b4de14d4-f88a-4bd7-b397-4d0cfc48ec54 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:41.380193 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-b4de14d4-f88a-4bd7-b397-4d0cfc48ec54 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:41.391326 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b4de14d4-f88a-4bd7-b397-4d0cfc48ec54 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:41.391882 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b4de14d4-f88a-4bd7-b397-4d0cfc48ec54 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:41.392426 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b4de14d4-f88a-4bd7-b397-4d0cfc48ec54 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:41.393226 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b4de14d4-f88a-4bd7-b397-4d0cfc48ec54 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:41.393673 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b4de14d4-f88a-4bd7-b397-4d0cfc48ec54 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:41.394097 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b4de14d4-f88a-4bd7-b397-4d0cfc48ec54 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:41.539161 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-b4de14d4-f88a-4bd7-b397-4d0cfc48ec54 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:41.547904 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-b4de14d4-f88a-4bd7-b397-4d0cfc48ec54 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b" status: 200 len: 1522 microversion: 2.1 time: 0.172664 Oct 18 11:45:41.548496 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 334/692] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:41 2022] GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:42.005991 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ca7cc774-d4ef-42d9-8eae-300a7655517f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:42.008120 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-ca7cc774-d4ef-42d9-8eae-300a7655517f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:42.014370 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ca7cc774-d4ef-42d9-8eae-300a7655517f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:42.014844 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ca7cc774-d4ef-42d9-8eae-300a7655517f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:42.015273 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ca7cc774-d4ef-42d9-8eae-300a7655517f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:42.015954 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ca7cc774-d4ef-42d9-8eae-300a7655517f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:42.016400 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ca7cc774-d4ef-42d9-8eae-300a7655517f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:42.016820 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ca7cc774-d4ef-42d9-8eae-300a7655517f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:42.045673 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-ca7cc774-d4ef-42d9-8eae-300a7655517f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044106 Oct 18 11:45:42.046219 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 359/693] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Oct 18 11:45:42 2022] GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:45:42.572080 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-2f91ec11-d4a2-4655-97a3-1cf931d78ee1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:42.572654 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-2f91ec11-d4a2-4655-97a3-1cf931d78ee1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:42.579010 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2f91ec11-d4a2-4655-97a3-1cf931d78ee1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:42.579486 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2f91ec11-d4a2-4655-97a3-1cf931d78ee1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:42.579916 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2f91ec11-d4a2-4655-97a3-1cf931d78ee1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:42.580594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2f91ec11-d4a2-4655-97a3-1cf931d78ee1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:42.581081 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2f91ec11-d4a2-4655-97a3-1cf931d78ee1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:42.581766 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2f91ec11-d4a2-4655-97a3-1cf931d78ee1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:42.710253 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-2f91ec11-d4a2-4655-97a3-1cf931d78ee1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:42.717910 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-2f91ec11-d4a2-4655-97a3-1cf931d78ee1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b" status: 200 len: 1522 microversion: 2.1 time: 0.149829 Oct 18 11:45:42.718474 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 335/694] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:42 2022] GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:43.057324 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-d4607755-5856-4371-9c12-35c1649b1793 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:43.059448 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-d4607755-5856-4371-9c12-35c1649b1793 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:43.065865 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d4607755-5856-4371-9c12-35c1649b1793 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:43.066339 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d4607755-5856-4371-9c12-35c1649b1793 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:43.066770 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d4607755-5856-4371-9c12-35c1649b1793 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:43.067449 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d4607755-5856-4371-9c12-35c1649b1793 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:43.067894 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d4607755-5856-4371-9c12-35c1649b1793 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:43.068309 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d4607755-5856-4371-9c12-35c1649b1793 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:43.097850 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-d4607755-5856-4371-9c12-35c1649b1793 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044376 Oct 18 11:45:43.098399 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 360/695] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Oct 18 11:45:43 2022] GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:45:43.741249 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-ffab3a7c-f668-40bf-aa6e-db9b850ed912 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:43.741862 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-ffab3a7c-f668-40bf-aa6e-db9b850ed912 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:43.748117 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ffab3a7c-f668-40bf-aa6e-db9b850ed912 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:43.748593 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ffab3a7c-f668-40bf-aa6e-db9b850ed912 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:43.749099 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ffab3a7c-f668-40bf-aa6e-db9b850ed912 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:43.749788 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ffab3a7c-f668-40bf-aa6e-db9b850ed912 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:43.750230 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ffab3a7c-f668-40bf-aa6e-db9b850ed912 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:43.750645 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ffab3a7c-f668-40bf-aa6e-db9b850ed912 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:44.000154 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-ffab3a7c-f668-40bf-aa6e-db9b850ed912 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:44.008382 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-ffab3a7c-f668-40bf-aa6e-db9b850ed912 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b" status: 200 len: 1522 microversion: 2.1 time: 0.271414 Oct 18 11:45:44.008964 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 336/696] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:43 2022] GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:44.110227 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-25532743-695a-4183-af59-679f83746d55 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:44.112370 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-25532743-695a-4183-af59-679f83746d55 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:44.119159 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-25532743-695a-4183-af59-679f83746d55 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:44.119647 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-25532743-695a-4183-af59-679f83746d55 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:44.120085 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-25532743-695a-4183-af59-679f83746d55 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:44.120774 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-25532743-695a-4183-af59-679f83746d55 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:44.121414 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-25532743-695a-4183-af59-679f83746d55 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:44.121835 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-25532743-695a-4183-af59-679f83746d55 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:44.153396 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-25532743-695a-4183-af59-679f83746d55 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046945 Oct 18 11:45:44.153882 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 361/697] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Oct 18 11:45:44 2022] GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 11:45:44.226652 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-9f4e1fe0-434f-4a12-bc0c-3e6d799ffd7e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:44.229958 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-9f4e1fe0-434f-4a12-bc0c-3e6d799ffd7e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:44.238424 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9f4e1fe0-434f-4a12-bc0c-3e6d799ffd7e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:44.238992 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9f4e1fe0-434f-4a12-bc0c-3e6d799ffd7e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:44.240125 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9f4e1fe0-434f-4a12-bc0c-3e6d799ffd7e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:44.241116 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9f4e1fe0-434f-4a12-bc0c-3e6d799ffd7e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:44.241637 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9f4e1fe0-434f-4a12-bc0c-3e6d799ffd7e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:44.242265 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9f4e1fe0-434f-4a12-bc0c-3e6d799ffd7e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:44.268318 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-9f4e1fe0-434f-4a12-bc0c-3e6d799ffd7e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Going to try to terminate instance {{(pid=125486) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 11:45:44.280778 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-520f5dde-ea00-400d-aabe-c5fa49e140c9 req-d55e6dac-6614-4147-9fb1-baca6cdade37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "774e4e5d-2e5c-40f1-943e-cb9bfd39738b", "name": "network-vif-deleted", "tag": "79c25e94-9586-406b-90b5-8070148e296f"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:45:44.291093 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-520f5dde-ea00-400d-aabe-c5fa49e140c9 req-d55e6dac-6614-4147-9fb1-baca6cdade37 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:44.291726 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-520f5dde-ea00-400d-aabe-c5fa49e140c9 req-d55e6dac-6614-4147-9fb1-baca6cdade37 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:44.292156 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-520f5dde-ea00-400d-aabe-c5fa49e140c9 req-d55e6dac-6614-4147-9fb1-baca6cdade37 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:44.304302 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-520f5dde-ea00-400d-aabe-c5fa49e140c9 req-d55e6dac-6614-4147-9fb1-baca6cdade37 service nova] Creating event network-vif-deleted:79c25e94-9586-406b-90b5-8070148e296f for instance 774e4e5d-2e5c-40f1-943e-cb9bfd39738b on hv-cinder-81558 Oct 18 11:45:44.310230 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-520f5dde-ea00-400d-aabe-c5fa49e140c9 req-d55e6dac-6614-4147-9fb1-baca6cdade37 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033075 Oct 18 11:45:44.311379 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 362/698] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:45:44.355383 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-9f4e1fe0-434f-4a12-bc0c-3e6d799ffd7e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a" status: 204 len: 0 microversion: 2.1 time: 0.133572 Oct 18 11:45:44.355975 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 337/699] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Oct 18 11:45:44 2022] DELETE /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 11:45:44.365947 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-f2cc6939-c100-4c78-a9ed-feb244b8bbd9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:44.366838 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-f2cc6939-c100-4c78-a9ed-feb244b8bbd9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:44.373361 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f2cc6939-c100-4c78-a9ed-feb244b8bbd9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:44.374063 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f2cc6939-c100-4c78-a9ed-feb244b8bbd9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:44.374693 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f2cc6939-c100-4c78-a9ed-feb244b8bbd9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:44.375419 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f2cc6939-c100-4c78-a9ed-feb244b8bbd9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:44.376030 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f2cc6939-c100-4c78-a9ed-feb244b8bbd9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:44.376448 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f2cc6939-c100-4c78-a9ed-feb244b8bbd9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:44.507703 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-f2cc6939-c100-4c78-a9ed-feb244b8bbd9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:44.515392 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-f2cc6939-c100-4c78-a9ed-feb244b8bbd9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a" status: 200 len: 1680 microversion: 2.1 time: 0.154775 Oct 18 11:45:44.515947 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 363/700] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:44 2022] GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:45.032373 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-6a4b9c2a-8f4e-47d0-8c7e-86ae96a38472 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:45.033785 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-6a4b9c2a-8f4e-47d0-8c7e-86ae96a38472 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:45.040373 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6a4b9c2a-8f4e-47d0-8c7e-86ae96a38472 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:45.041203 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6a4b9c2a-8f4e-47d0-8c7e-86ae96a38472 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:45.041940 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6a4b9c2a-8f4e-47d0-8c7e-86ae96a38472 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:45.042541 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6a4b9c2a-8f4e-47d0-8c7e-86ae96a38472 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:45.042982 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6a4b9c2a-8f4e-47d0-8c7e-86ae96a38472 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:45.043425 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6a4b9c2a-8f4e-47d0-8c7e-86ae96a38472 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:45.075808 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6a4b9c2a-8f4e-47d0-8c7e-86ae96a38472 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:45.076283 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6a4b9c2a-8f4e-47d0-8c7e-86ae96a38472 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:45.076708 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6a4b9c2a-8f4e-47d0-8c7e-86ae96a38472 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:45.077172 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.objects.instance [None req-6a4b9c2a-8f4e-47d0-8c7e-86ae96a38472 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lazy-loading 'fault' on Instance uuid 774e4e5d-2e5c-40f1-943e-cb9bfd39738b {{(pid=125486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:45:45.122839 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-6a4b9c2a-8f4e-47d0-8c7e-86ae96a38472 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:45.131001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-6a4b9c2a-8f4e-47d0-8c7e-86ae96a38472 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b" status: 200 len: 1311 microversion: 2.1 time: 0.103066 Oct 18 11:45:45.131560 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 338/701] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:45 2022] GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:45.539041 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-9842fc8c-3773-4799-86da-9b13687b07e8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:45.539643 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-9842fc8c-3773-4799-86da-9b13687b07e8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:45.546093 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9842fc8c-3773-4799-86da-9b13687b07e8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:45.546575 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9842fc8c-3773-4799-86da-9b13687b07e8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:45.547007 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9842fc8c-3773-4799-86da-9b13687b07e8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:45.547692 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9842fc8c-3773-4799-86da-9b13687b07e8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:45.548139 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9842fc8c-3773-4799-86da-9b13687b07e8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:45.548555 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9842fc8c-3773-4799-86da-9b13687b07e8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:45.679822 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-9842fc8c-3773-4799-86da-9b13687b07e8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:45.687396 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-9842fc8c-3773-4799-86da-9b13687b07e8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a" status: 200 len: 1680 microversion: 2.1 time: 0.152283 Oct 18 11:45:45.687949 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 364/702] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:45 2022] GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:46.154126 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-77321e6a-6185-48fd-98d7-75f6db9f8ca1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:46.154682 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-77321e6a-6185-48fd-98d7-75f6db9f8ca1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:46.161118 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-77321e6a-6185-48fd-98d7-75f6db9f8ca1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:46.161596 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-77321e6a-6185-48fd-98d7-75f6db9f8ca1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:46.162022 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-77321e6a-6185-48fd-98d7-75f6db9f8ca1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:46.162700 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-77321e6a-6185-48fd-98d7-75f6db9f8ca1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:46.163144 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-77321e6a-6185-48fd-98d7-75f6db9f8ca1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:46.163558 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-77321e6a-6185-48fd-98d7-75f6db9f8ca1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:46.196170 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-77321e6a-6185-48fd-98d7-75f6db9f8ca1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:46.196659 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-77321e6a-6185-48fd-98d7-75f6db9f8ca1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:46.197149 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-77321e6a-6185-48fd-98d7-75f6db9f8ca1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:46.197582 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.objects.instance [None req-77321e6a-6185-48fd-98d7-75f6db9f8ca1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lazy-loading 'fault' on Instance uuid 774e4e5d-2e5c-40f1-943e-cb9bfd39738b {{(pid=125486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:45:46.237303 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-77321e6a-6185-48fd-98d7-75f6db9f8ca1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f624c36a3574b61bd17d5d73af71916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd52252f24114465af9bdf6e6fe68b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:46.245413 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-77321e6a-6185-48fd-98d7-75f6db9f8ca1 tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b" status: 200 len: 1311 microversion: 2.1 time: 0.095242 Oct 18 11:45:46.245980 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 339/703] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:46 2022] GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:45:46.711735 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-453b8908-be5f-4825-b204-39826848d60c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:46.712261 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-453b8908-be5f-4825-b204-39826848d60c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:46.718396 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-453b8908-be5f-4825-b204-39826848d60c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:46.718996 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-453b8908-be5f-4825-b204-39826848d60c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:46.719431 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-453b8908-be5f-4825-b204-39826848d60c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:46.720121 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-453b8908-be5f-4825-b204-39826848d60c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:46.720570 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-453b8908-be5f-4825-b204-39826848d60c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:46.721172 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-453b8908-be5f-4825-b204-39826848d60c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:46.851143 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-453b8908-be5f-4825-b204-39826848d60c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:46.859217 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-453b8908-be5f-4825-b204-39826848d60c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a" status: 200 len: 1680 microversion: 2.1 time: 0.152093 Oct 18 11:45:46.859809 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 365/704] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:46 2022] GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:47.268834 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-b469371d-c035-47a2-a6f0-408db54a09bb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:47.269551 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-b469371d-c035-47a2-a6f0-408db54a09bb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] [instance: 774e4e5d-2e5c-40f1-943e-cb9bfd39738b] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:47.275996 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b469371d-c035-47a2-a6f0-408db54a09bb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:47.276473 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b469371d-c035-47a2-a6f0-408db54a09bb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:47.276924 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b469371d-c035-47a2-a6f0-408db54a09bb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:47.277607 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b469371d-c035-47a2-a6f0-408db54a09bb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:47.278049 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b469371d-c035-47a2-a6f0-408db54a09bb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:47.278462 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b469371d-c035-47a2-a6f0-408db54a09bb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:47.292264 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.wsgi [None req-b469371d-c035-47a2-a6f0-408db54a09bb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] HTTP exception thrown: Instance 774e4e5d-2e5c-40f1-943e-cb9bfd39738b could not be found. Oct 18 11:45:47.293864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-b469371d-c035-47a2-a6f0-408db54a09bb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Request method failure captured: Oct 18 11:45:47.293864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: request: GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b HTTP/1.1 Oct 18 11:45:47.293864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept: application/json Oct 18 11:45:47.293864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept-Encoding: identity Oct 18 11:45:47.293864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Connection: close Oct 18 11:45:47.293864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Length: 0 Oct 18 11:45:47.293864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Type: application/json Oct 18 11:45:47.293864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Host: 10.222.0.17 Oct 18 11:45:47.293864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Openstack-System-Scope: None Oct 18 11:45:47.293864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: User-Agent: python-urllib3/1.26.12 Oct 18 11:45:47.293864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Auth-Token: gAAAAABjTpCyITCOuZ_3FbMTs3DhKEW_OwwcrGod2a_lrP_UNCZrETSVqjf-o7Z_Za1EvdYUbGePPsNMV1lYEK1fAp16Ng8WUSaI3Prsxzq9uX4zhASpgMp9MLYGWUxlDXz9kmC1mhrxhXDkhFi9KB2Jd7SlJFgu7FNGvZ6QYPd5pDBE_uJGE7M Oct 18 11:45:47.293864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Id: None Oct 18 11:45:47.293864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Name: None Oct 18 11:45:47.293864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Identity-Status: Confirmed Oct 18 11:45:47.293864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Is-Admin-Project: True Oct 18 11:45:47.293864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Id: default Oct 18 11:45:47.293864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Name: Default Oct 18 11:45:47.293864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Id: cd52252f24114465af9bdf6e6fe68b76 Oct 18 11:45:47.293864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1678509525 Oct 18 11:45:47.293864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Role: reader,member Oct 18 11:45:47.293864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Roles: reader,member Oct 18 11:45:47.295232 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd52252f24114465af9bdf6e6fe68b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cd52252f24114465af9bdf6e6fe68b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cd52252f24114465af9bdf6e6fe68b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd52252f24114465af9bdf6e6fe68b76"}]}] Oct 18 11:45:47.295232 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1678509525 Oct 18 11:45:47.295232 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Id: cd52252f24114465af9bdf6e6fe68b76 Oct 18 11:45:47.295232 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1678509525 Oct 18 11:45:47.295232 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User: tempest-ServerRescueNegativeTestJSON-1678509525-project Oct 18 11:45:47.295232 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Id: default Oct 18 11:45:47.295232 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Name: Default Oct 18 11:45:47.295232 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Id: 1f624c36a3574b61bd17d5d73af71916 Oct 18 11:45:47.295232 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1678509525-project Oct 18 11:45:47.295232 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: method: > Oct 18 11:45:47.295232 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: exception: Instance 774e4e5d-2e5c-40f1-943e-cb9bfd39738b could not be found. Oct 18 11:45:47.295232 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: action_args: {'id': '774e4e5d-2e5c-40f1-943e-cb9bfd39738b'} Oct 18 11:45:47.295946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:45:47.295946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:45:47.295946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:45:47.295946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:45:47.295946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:45:47.295946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:45:47.295946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:45:47.295946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:45:47.295946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:45:47.295946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:45:47.295946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 774e4e5d-2e5c-40f1-943e-cb9bfd39738b could not be found. Oct 18 11:45:47.295946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:45:47.295946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:45:47.295946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:45:47.295946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:45:47.295946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:45:47.295946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:45:47.295946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:45:47.295946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:45:47.295946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:45:47.297197 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:45:47.297197 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 11:45:47.297197 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 11:45:47.297197 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:45:47.297197 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:45:47.297197 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:45:47.297197 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:45:47.297197 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 774e4e5d-2e5c-40f1-943e-cb9bfd39738b could not be found. Oct 18 11:45:47.297197 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:45:47.297197 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:45:47.297197 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:45:47.297197 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:45:47.297197 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:45:47.297197 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:45:47.297197 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:45:47.297197 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:45:47.297197 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 774e4e5d-2e5c-40f1-943e-cb9bfd39738b could not be found. Oct 18 11:45:47.297197 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:45:47.298279 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-b469371d-c035-47a2-a6f0-408db54a09bb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] Returning 404 to user: Instance 774e4e5d-2e5c-40f1-943e-cb9bfd39738b could not be found. {{(pid=125486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:45:47.298279 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-b469371d-c035-47a2-a6f0-408db54a09bb tempest-ServerRescueNegativeTestJSON-1678509525 tempest-ServerRescueNegativeTestJSON-1678509525-project] 10.222.0.17 "GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b" status: 404 len: 111 microversion: 2.1 time: 0.030458 Oct 18 11:45:47.298279 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 340/705] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:47 2022] GET /compute/v2.1/servers/774e4e5d-2e5c-40f1-943e-cb9bfd39738b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:45:47.478466 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-985d5b23-aeeb-4db3-9464-3a565f9024ff req-db5fbc93-37c4-4f18-9dd6-a37bc8b186e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a", "name": "network-vif-deleted", "tag": "57038a22-7ba2-4f5b-9e92-8aaac3f8c774"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:45:47.493416 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-985d5b23-aeeb-4db3-9464-3a565f9024ff req-db5fbc93-37c4-4f18-9dd6-a37bc8b186e9 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:47.494172 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-985d5b23-aeeb-4db3-9464-3a565f9024ff req-db5fbc93-37c4-4f18-9dd6-a37bc8b186e9 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:47.494773 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-985d5b23-aeeb-4db3-9464-3a565f9024ff req-db5fbc93-37c4-4f18-9dd6-a37bc8b186e9 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:47.509255 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-985d5b23-aeeb-4db3-9464-3a565f9024ff req-db5fbc93-37c4-4f18-9dd6-a37bc8b186e9 service nova] Creating event network-vif-deleted:57038a22-7ba2-4f5b-9e92-8aaac3f8c774 for instance 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a on hv-cinder-81558 Oct 18 11:45:47.515765 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-985d5b23-aeeb-4db3-9464-3a565f9024ff req-db5fbc93-37c4-4f18-9dd6-a37bc8b186e9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040869 Oct 18 11:45:47.516577 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 366/706] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:45:47.886508 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-640ed9ef-7eb9-4a8e-83e6-050577d77185 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:47.887178 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-640ed9ef-7eb9-4a8e-83e6-050577d77185 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:47.894951 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-640ed9ef-7eb9-4a8e-83e6-050577d77185 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:47.895989 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-640ed9ef-7eb9-4a8e-83e6-050577d77185 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:47.897100 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-640ed9ef-7eb9-4a8e-83e6-050577d77185 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:47.898041 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-640ed9ef-7eb9-4a8e-83e6-050577d77185 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:47.898771 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-640ed9ef-7eb9-4a8e-83e6-050577d77185 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:47.899402 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-640ed9ef-7eb9-4a8e-83e6-050577d77185 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:47.934076 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-640ed9ef-7eb9-4a8e-83e6-050577d77185 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:47.934548 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-640ed9ef-7eb9-4a8e-83e6-050577d77185 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:47.934976 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-640ed9ef-7eb9-4a8e-83e6-050577d77185 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:47.935418 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.objects.instance [None req-640ed9ef-7eb9-4a8e-83e6-050577d77185 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lazy-loading 'fault' on Instance uuid 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a {{(pid=125486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:45:47.978923 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-640ed9ef-7eb9-4a8e-83e6-050577d77185 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:47.988524 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-640ed9ef-7eb9-4a8e-83e6-050577d77185 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a" status: 200 len: 1331 microversion: 2.1 time: 0.105940 Oct 18 11:45:47.989162 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 341/707] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:47 2022] GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a => generated 1331 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:49.012299 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ff7065b8-a550-4508-a329-45e8e0e82bf1 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:49.014036 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-ff7065b8-a550-4508-a329-45e8e0e82bf1 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:49.022907 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ff7065b8-a550-4508-a329-45e8e0e82bf1 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:49.024348 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ff7065b8-a550-4508-a329-45e8e0e82bf1 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:49.025066 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ff7065b8-a550-4508-a329-45e8e0e82bf1 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:49.026468 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ff7065b8-a550-4508-a329-45e8e0e82bf1 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:49.027345 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ff7065b8-a550-4508-a329-45e8e0e82bf1 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:49.027926 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ff7065b8-a550-4508-a329-45e8e0e82bf1 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:49.049860 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.wsgi [None req-ff7065b8-a550-4508-a329-45e8e0e82bf1 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] HTTP exception thrown: Instance 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a could not be found. Oct 18 11:45:49.051877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ff7065b8-a550-4508-a329-45e8e0e82bf1 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Request method failure captured: Oct 18 11:45:49.051877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a HTTP/1.1 Oct 18 11:45:49.051877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:45:49.051877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:45:49.051877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:45:49.051877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 0 Oct 18 11:45:49.051877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:45:49.051877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:45:49.051877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:45:49.051877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:45:49.051877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpC0QX2SvHowI5-vz58GDwpVMERgGiI-pqt2GQ4o1fdQFbeIrfuLVtcw55IWYTDh91fNo1KVKFcag_YfGjslSHmWVAe8eH9iiMTcKmdOtt4MUEPPWZ9OQcF5wlXB0WJP-XHDUtk0mAsVICaitUhEDH7cqfrNMho4FbOB0yKZgk6M4Ns Oct 18 11:45:49.051877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:45:49.051877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:45:49.051877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:45:49.051877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:45:49.051877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:45:49.051877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:45:49.051877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: 633afaabbbff47a4a99ebc997e67b01a Oct 18 11:45:49.051877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:45:49.051877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:45:49.051877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:45:49.053383 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/633afaabbbff47a4a99ebc997e67b01a"}]}] Oct 18 11:45:49.053383 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:45:49.053383 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: 633afaabbbff47a4a99ebc997e67b01a Oct 18 11:45:49.053383 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:45:49.053383 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-AttachVolumeNegativeTest-1091652349-project Oct 18 11:45:49.053383 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:45:49.053383 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:45:49.053383 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: 916699a212eb4d8aa945f299ac0d4c96 Oct 18 11:45:49.053383 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-AttachVolumeNegativeTest-1091652349-project Oct 18 11:45:49.053383 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: > Oct 18 11:45:49.053383 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Instance 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a could not be found. Oct 18 11:45:49.053383 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'id': '8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a'} Oct 18 11:45:49.054102 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:45:49.054102 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:45:49.054102 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:45:49.054102 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:45:49.054102 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:45:49.054102 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:45:49.054102 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:45:49.054102 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:45:49.054102 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:45:49.054102 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:45:49.054102 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a could not be found. Oct 18 11:45:49.054102 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:45:49.054102 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:45:49.054102 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:45:49.054102 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:45:49.054102 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:45:49.054102 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:45:49.054102 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:45:49.054102 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:45:49.054102 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:45:49.055265 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:45:49.055265 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 11:45:49.055265 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 11:45:49.055265 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:45:49.055265 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:45:49.055265 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:45:49.055265 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:45:49.055265 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a could not be found. Oct 18 11:45:49.055265 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:45:49.055265 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:45:49.055265 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:45:49.055265 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:45:49.055265 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:45:49.055265 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:45:49.055265 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:45:49.055265 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:45:49.055265 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a could not be found. Oct 18 11:45:49.055265 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:45:49.058329 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ff7065b8-a550-4508-a329-45e8e0e82bf1 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Returning 404 to user: Instance 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a could not be found. {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:45:49.059692 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-ff7065b8-a550-4508-a329-45e8e0e82bf1 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a" status: 404 len: 111 microversion: 2.1 time: 0.051784 Oct 18 11:45:49.060446 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 367/708] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:49 2022] GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:45:49.069133 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-00ff8d27-fa32-43e3-993e-704f43af7e00 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '.version_select at 0x7f4bdbd6b4c0>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:49.101371 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-00ff8d27-fa32-43e3-993e-704f43af7e00 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1087759069" status: 202 len: 0 microversion: 2.1 time: 0.034831 Oct 18 11:45:49.101999 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 342/709] 10.222.0.17 () {58 vars in 1221 bytes} [Tue Oct 18 11:45:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1087759069 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 11:45:50.214989 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-2cc9ad69-86b6-4368-8a13-9e63c253663d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Action: 'create', calling method: .version_select at 0x7f4bdbe90ca0>, body: {"keypair": {"name": "tempest-keypair-1999600117", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvVk8IfbODsBthAoRNYyz8MiwMYjutmazcjsOgB9YWjGDdPCqkHDMqnASUnR+eXxC2CCiJs+QdSgSVPeU0mrq3aC71m9Nq50k1EjHKh7v2C1yRUwIkAyEUBhMrx1R9HGg=="}} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:45:50.231217 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.quota [None req-2cc9ad69-86b6-4368-8a13-9e63c253663d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Getting quotas for project 633afaabbbff47a4a99ebc997e67b01a. Resources: {'key_pairs'} {{(pid=125485) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:45:50.235064 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.quota [None req-2cc9ad69-86b6-4368-8a13-9e63c253663d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Getting quotas for user 916699a212eb4d8aa945f299ac0d4c96 and project 633afaabbbff47a4a99ebc997e67b01a. Resources: {'key_pairs'} {{(pid=125485) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:45:50.258046 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-2cc9ad69-86b6-4368-8a13-9e63c253663d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047000 Oct 18 11:45:50.258953 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 368/710] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Oct 18 11:45:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:45:52.042356 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-2224a3e5-eb56-4441-9e46-d6fe608b71ce tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1124135204", "imageRef": "a4917b56-ebe0-409a-894a-469900c12b94", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb24f3be-68a7-4ca5-a331-f9f5950dbafd"}], "security_groups": [{"name": "tempest-securitygroup--2136859241"}], "key_name": "tempest-keypair-1999600117", "user_data": "}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:45:52.157458 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.network.neutron [None req-2224a3e5-eb56-4441-9e46-d6fe608b71ce tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] validate_networks() for [('eb24f3be-68a7-4ca5-a331-f9f5950dbafd', None, None, None, None, None)] {{(pid=125486) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 11:45:52.646243 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-2224a3e5-eb56-4441-9e46-d6fe608b71ce tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Flavor limits 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 11:45:52.646661 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-2224a3e5-eb56-4441-9e46-d6fe608b71ce tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Image limits 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 11:45:52.647877 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-2224a3e5-eb56-4441-9e46-d6fe608b71ce tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Flavor pref 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 11:45:52.648299 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-2224a3e5-eb56-4441-9e46-d6fe608b71ce tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Image pref 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 11:45:52.648703 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-2224a3e5-eb56-4441-9e46-d6fe608b71ce tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 11:45:52.657832 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2224a3e5-eb56-4441-9e46-d6fe608b71ce tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:52.658237 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2224a3e5-eb56-4441-9e46-d6fe608b71ce tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:52.658691 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2224a3e5-eb56-4441-9e46-d6fe608b71ce tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:52.659394 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2224a3e5-eb56-4441-9e46-d6fe608b71ce tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:52.659834 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2224a3e5-eb56-4441-9e46-d6fe608b71ce tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:52.660328 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2224a3e5-eb56-4441-9e46-d6fe608b71ce tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:52.677695 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-2224a3e5-eb56-4441-9e46-d6fe608b71ce tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Getting quotas for project 633afaabbbff47a4a99ebc997e67b01a. Resources: {'cores', 'instances', 'ram'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:45:52.681675 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-2224a3e5-eb56-4441-9e46-d6fe608b71ce tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Getting quotas for user 916699a212eb4d8aa945f299ac0d4c96 and project 633afaabbbff47a4a99ebc997e67b01a. Resources: {'cores', 'instances', 'ram'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:45:52.693704 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-2224a3e5-eb56-4441-9e46-d6fe608b71ce tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Going to run 1 instances... {{(pid=125486) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 11:45:52.696001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-2224a3e5-eb56-4441-9e46-d6fe608b71ce tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 736e19d9-edb8-4f3d-93c0-0a3e59c395fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4917b56-ebe0-409a-894a-469900c12b94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 11:45:52.743438 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-2224a3e5-eb56-4441-9e46-d6fe608b71ce tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.705971 Oct 18 11:45:52.744440 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 343/711] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Oct 18 11:45:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 11:45:52.756628 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-eaccfa15-0299-4dbd-bee9-38cf4157ebc9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:52.757258 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-eaccfa15-0299-4dbd-bee9-38cf4157ebc9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 736e19d9-edb8-4f3d-93c0-0a3e59c395fd] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:52.831940 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-eaccfa15-0299-4dbd-bee9-38cf4157ebc9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:52.841600 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-eaccfa15-0299-4dbd-bee9-38cf4157ebc9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd" status: 200 len: 1242 microversion: 2.1 time: 0.089988 Oct 18 11:45:52.842330 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 369/712] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:52 2022] GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:45:53.864754 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-e7a0447d-c921-451e-be5d-d3d5320f96d1 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:53.865434 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-e7a0447d-c921-451e-be5d-d3d5320f96d1 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 736e19d9-edb8-4f3d-93c0-0a3e59c395fd] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:53.875510 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e7a0447d-c921-451e-be5d-d3d5320f96d1 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:53.876099 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e7a0447d-c921-451e-be5d-d3d5320f96d1 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:53.876604 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e7a0447d-c921-451e-be5d-d3d5320f96d1 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:53.877409 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e7a0447d-c921-451e-be5d-d3d5320f96d1 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:53.877960 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e7a0447d-c921-451e-be5d-d3d5320f96d1 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:53.879244 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e7a0447d-c921-451e-be5d-d3d5320f96d1 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:53.946510 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-e7a0447d-c921-451e-be5d-d3d5320f96d1 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:53.955232 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-e7a0447d-c921-451e-be5d-d3d5320f96d1 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd" status: 200 len: 1294 microversion: 2.1 time: 0.094829 Oct 18 11:45:53.956073 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 344/713] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:53 2022] GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd => generated 1294 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:54.982586 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-48a73f5c-18e8-4762-ad81-5223e26c6f0f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:54.984118 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-48a73f5c-18e8-4762-ad81-5223e26c6f0f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 736e19d9-edb8-4f3d-93c0-0a3e59c395fd] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:54.992300 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-48a73f5c-18e8-4762-ad81-5223e26c6f0f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:54.993158 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-48a73f5c-18e8-4762-ad81-5223e26c6f0f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:54.993880 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-48a73f5c-18e8-4762-ad81-5223e26c6f0f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:54.994923 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-48a73f5c-18e8-4762-ad81-5223e26c6f0f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:54.995567 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-48a73f5c-18e8-4762-ad81-5223e26c6f0f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:54.996389 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-48a73f5c-18e8-4762-ad81-5223e26c6f0f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:55.166734 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-48a73f5c-18e8-4762-ad81-5223e26c6f0f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:55.187112 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-48a73f5c-18e8-4762-ad81-5223e26c6f0f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd" status: 200 len: 1368 microversion: 2.1 time: 0.210300 Oct 18 11:45:55.187785 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 370/714] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:54 2022] GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd => generated 1368 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:56.041758 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-67d199aa-c2fb-48ab-8c38-0ca2358f6828 req-eb05606d-6974-4ca9-b0e4-d9d3f1128ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "736e19d9-edb8-4f3d-93c0-0a3e59c395fd", "tag": "3c5dcfc4-904b-4c1f-9715-95cec1d6e317"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:45:56.073154 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-67d199aa-c2fb-48ab-8c38-0ca2358f6828 req-eb05606d-6974-4ca9-b0e4-d9d3f1128ac2 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:56.073154 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-67d199aa-c2fb-48ab-8c38-0ca2358f6828 req-eb05606d-6974-4ca9-b0e4-d9d3f1128ac2 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:56.073154 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-67d199aa-c2fb-48ab-8c38-0ca2358f6828 req-eb05606d-6974-4ca9-b0e4-d9d3f1128ac2 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:56.075515 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-67d199aa-c2fb-48ab-8c38-0ca2358f6828 req-eb05606d-6974-4ca9-b0e4-d9d3f1128ac2 service nova] Creating event network-changed:3c5dcfc4-904b-4c1f-9715-95cec1d6e317 for instance 736e19d9-edb8-4f3d-93c0-0a3e59c395fd on hv-cinder-81558 Oct 18 11:45:56.082877 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-67d199aa-c2fb-48ab-8c38-0ca2358f6828 req-eb05606d-6974-4ca9-b0e4-d9d3f1128ac2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050946 Oct 18 11:45:56.084291 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 345/715] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:45:56.213179 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-0b88429c-f8bc-47cb-a147-a38548d45df9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:56.213179 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-0b88429c-f8bc-47cb-a147-a38548d45df9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 736e19d9-edb8-4f3d-93c0-0a3e59c395fd] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:56.219567 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0b88429c-f8bc-47cb-a147-a38548d45df9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:56.220049 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0b88429c-f8bc-47cb-a147-a38548d45df9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:56.220504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0b88429c-f8bc-47cb-a147-a38548d45df9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:56.221375 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0b88429c-f8bc-47cb-a147-a38548d45df9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:56.221942 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0b88429c-f8bc-47cb-a147-a38548d45df9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:56.222734 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0b88429c-f8bc-47cb-a147-a38548d45df9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:56.355127 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-0b88429c-f8bc-47cb-a147-a38548d45df9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:56.358656 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:45:56.363230 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-0b88429c-f8bc-47cb-a147-a38548d45df9 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd" status: 200 len: 1368 microversion: 2.1 time: 0.155215 Oct 18 11:45:56.365606 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 371/716] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:56 2022] GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:56.480691 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-5c7321fd-5f6f-4c9b-8e2b-1d49a8b388e6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:45:56.481330 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-5c7321fd-5f6f-4c9b-8e2b-1d49a8b388e6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:56.487422 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5c7321fd-5f6f-4c9b-8e2b-1d49a8b388e6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:56.487899 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5c7321fd-5f6f-4c9b-8e2b-1d49a8b388e6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:56.488327 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5c7321fd-5f6f-4c9b-8e2b-1d49a8b388e6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:56.489715 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5c7321fd-5f6f-4c9b-8e2b-1d49a8b388e6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:56.490168 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5c7321fd-5f6f-4c9b-8e2b-1d49a8b388e6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:56.490582 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5c7321fd-5f6f-4c9b-8e2b-1d49a8b388e6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:56.513291 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.objects.instance [None req-5c7321fd-5f6f-4c9b-8e2b-1d49a8b388e6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lazy-loading 'flavor' on Instance uuid 29b0847b-6a68-4b35-91d4-1ce725985f01 {{(pid=125486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:45:56.533396 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:45:56.586771 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-5c7321fd-5f6f-4c9b-8e2b-1d49a8b388e6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "POST /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01/action" status: 202 len: 0 microversion: 2.1 time: 0.110088 Oct 18 11:45:56.587242 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 346/717] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Oct 18 11:45:56 2022] POST /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 11:45:56.596076 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-51a22940-d6a5-49d0-87f7-df2cbabd5063 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:56.596901 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-51a22940-d6a5-49d0-87f7-df2cbabd5063 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:56.604299 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-51a22940-d6a5-49d0-87f7-df2cbabd5063 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:56.604772 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-51a22940-d6a5-49d0-87f7-df2cbabd5063 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:56.605244 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-51a22940-d6a5-49d0-87f7-df2cbabd5063 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:56.605921 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-51a22940-d6a5-49d0-87f7-df2cbabd5063 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:56.606361 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-51a22940-d6a5-49d0-87f7-df2cbabd5063 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:56.606773 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-51a22940-d6a5-49d0-87f7-df2cbabd5063 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:56.735580 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-51a22940-d6a5-49d0-87f7-df2cbabd5063 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:56.743385 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-51a22940-d6a5-49d0-87f7-df2cbabd5063 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1569 microversion: 2.1 time: 0.151851 Oct 18 11:45:56.743960 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 372/718] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:56 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:45:57.388955 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-8ad61ee4-f85a-453b-b863-08f473c5d5f8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:57.390314 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-8ad61ee4-f85a-453b-b863-08f473c5d5f8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 736e19d9-edb8-4f3d-93c0-0a3e59c395fd] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:57.397776 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8ad61ee4-f85a-453b-b863-08f473c5d5f8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:57.398176 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8ad61ee4-f85a-453b-b863-08f473c5d5f8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:57.398611 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8ad61ee4-f85a-453b-b863-08f473c5d5f8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:57.399312 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8ad61ee4-f85a-453b-b863-08f473c5d5f8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:57.399766 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8ad61ee4-f85a-453b-b863-08f473c5d5f8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:57.400367 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8ad61ee4-f85a-453b-b863-08f473c5d5f8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:57.600539 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-8ad61ee4-f85a-453b-b863-08f473c5d5f8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:57.608219 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-8ad61ee4-f85a-453b-b863-08f473c5d5f8 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd" status: 200 len: 1368 microversion: 2.1 time: 0.225353 Oct 18 11:45:57.608782 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 347/719] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:57 2022] GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd => generated 1368 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:57.766276 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-e414e455-2132-40a7-a756-6686aa56e72f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:57.766886 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-e414e455-2132-40a7-a756-6686aa56e72f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:57.773358 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e414e455-2132-40a7-a756-6686aa56e72f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:57.773842 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e414e455-2132-40a7-a756-6686aa56e72f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:57.774269 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e414e455-2132-40a7-a756-6686aa56e72f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:57.774959 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e414e455-2132-40a7-a756-6686aa56e72f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:57.775398 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e414e455-2132-40a7-a756-6686aa56e72f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:57.775823 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e414e455-2132-40a7-a756-6686aa56e72f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:57.905795 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-6c8a15f4-9969-41d5-b2b9-f00ba3772d7a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:57.906820 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-6c8a15f4-9969-41d5-b2b9-f00ba3772d7a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:57.913101 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6c8a15f4-9969-41d5-b2b9-f00ba3772d7a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:57.913498 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-e414e455-2132-40a7-a756-6686aa56e72f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:57.913634 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6c8a15f4-9969-41d5-b2b9-f00ba3772d7a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:57.914013 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6c8a15f4-9969-41d5-b2b9-f00ba3772d7a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:57.914770 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6c8a15f4-9969-41d5-b2b9-f00ba3772d7a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:57.915198 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6c8a15f4-9969-41d5-b2b9-f00ba3772d7a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:57.915618 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6c8a15f4-9969-41d5-b2b9-f00ba3772d7a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:57.921495 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-e414e455-2132-40a7-a756-6686aa56e72f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1569 microversion: 2.1 time: 0.158882 Oct 18 11:45:57.922014 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 348/720] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:57 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:45:57.941241 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-6c8a15f4-9969-41d5-b2b9-f00ba3772d7a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488/ips" status: 200 len: 146 microversion: 2.1 time: 0.208844 Oct 18 11:45:57.942299 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 373/721] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Oct 18 11:45:57 2022] GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488/ips => generated 146 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:45:58.631102 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-886300d2-22b4-4b87-baea-71feeed6b804 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:58.631708 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-886300d2-22b4-4b87-baea-71feeed6b804 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 736e19d9-edb8-4f3d-93c0-0a3e59c395fd] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:58.638180 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-886300d2-22b4-4b87-baea-71feeed6b804 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:58.638666 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-886300d2-22b4-4b87-baea-71feeed6b804 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:58.639120 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-886300d2-22b4-4b87-baea-71feeed6b804 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:58.639788 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-886300d2-22b4-4b87-baea-71feeed6b804 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:58.640241 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-886300d2-22b4-4b87-baea-71feeed6b804 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:58.640665 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-886300d2-22b4-4b87-baea-71feeed6b804 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:58.770303 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-886300d2-22b4-4b87-baea-71feeed6b804 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:58.778509 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-886300d2-22b4-4b87-baea-71feeed6b804 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd" status: 200 len: 1368 microversion: 2.1 time: 0.151293 Oct 18 11:45:58.779078 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 349/722] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:58 2022] GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:58.945768 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-5f8ac1f7-1f49-4ded-86f2-d07dbf5a7d36 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:58.946401 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-5f8ac1f7-1f49-4ded-86f2-d07dbf5a7d36 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:58.952707 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5f8ac1f7-1f49-4ded-86f2-d07dbf5a7d36 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:58.953203 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5f8ac1f7-1f49-4ded-86f2-d07dbf5a7d36 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:58.953626 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5f8ac1f7-1f49-4ded-86f2-d07dbf5a7d36 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:58.954298 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5f8ac1f7-1f49-4ded-86f2-d07dbf5a7d36 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:58.954739 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5f8ac1f7-1f49-4ded-86f2-d07dbf5a7d36 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:58.955150 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5f8ac1f7-1f49-4ded-86f2-d07dbf5a7d36 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:59.087524 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-5f8ac1f7-1f49-4ded-86f2-d07dbf5a7d36 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:59.095436 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-5f8ac1f7-1f49-4ded-86f2-d07dbf5a7d36 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1569 microversion: 2.1 time: 0.154148 Oct 18 11:45:59.096002 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 374/723] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:58 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:45:59.800997 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-3e9a6d42-7563-4fee-acd4-80f4b62a7c92 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:45:59.801590 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-3e9a6d42-7563-4fee-acd4-80f4b62a7c92 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 736e19d9-edb8-4f3d-93c0-0a3e59c395fd] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:45:59.808057 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3e9a6d42-7563-4fee-acd4-80f4b62a7c92 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:59.808530 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3e9a6d42-7563-4fee-acd4-80f4b62a7c92 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:59.809001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3e9a6d42-7563-4fee-acd4-80f4b62a7c92 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:59.809681 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3e9a6d42-7563-4fee-acd4-80f4b62a7c92 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:45:59.810128 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3e9a6d42-7563-4fee-acd4-80f4b62a7c92 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:45:59.810545 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3e9a6d42-7563-4fee-acd4-80f4b62a7c92 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:45:59.939645 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-3e9a6d42-7563-4fee-acd4-80f4b62a7c92 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:45:59.955048 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-3e9a6d42-7563-4fee-acd4-80f4b62a7c92 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd" status: 200 len: 1368 microversion: 2.1 time: 0.150694 Oct 18 11:45:59.955048 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 350/724] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:45:59 2022] GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:00.119392 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-be37c735-c52c-4240-b0c2-d3193f6ff095 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:00.119992 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-be37c735-c52c-4240-b0c2-d3193f6ff095 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:00.126350 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-be37c735-c52c-4240-b0c2-d3193f6ff095 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:00.126829 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-be37c735-c52c-4240-b0c2-d3193f6ff095 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:00.127257 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-be37c735-c52c-4240-b0c2-d3193f6ff095 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:00.127935 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-be37c735-c52c-4240-b0c2-d3193f6ff095 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:00.128378 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-be37c735-c52c-4240-b0c2-d3193f6ff095 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:00.128795 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-be37c735-c52c-4240-b0c2-d3193f6ff095 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:00.261242 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-be37c735-c52c-4240-b0c2-d3193f6ff095 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:00.272355 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-be37c735-c52c-4240-b0c2-d3193f6ff095 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1569 microversion: 2.1 time: 0.157020 Oct 18 11:46:00.284877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 375/725] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:00 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:00.971046 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-af588126-8ea0-4ef5-a68f-5cf41b7769f2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:00.971653 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-af588126-8ea0-4ef5-a68f-5cf41b7769f2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 736e19d9-edb8-4f3d-93c0-0a3e59c395fd] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:00.978563 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-af588126-8ea0-4ef5-a68f-5cf41b7769f2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:00.979042 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-af588126-8ea0-4ef5-a68f-5cf41b7769f2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:00.979474 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-af588126-8ea0-4ef5-a68f-5cf41b7769f2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:00.980152 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-af588126-8ea0-4ef5-a68f-5cf41b7769f2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:00.980602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-af588126-8ea0-4ef5-a68f-5cf41b7769f2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:00.981063 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-af588126-8ea0-4ef5-a68f-5cf41b7769f2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:01.113551 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-af588126-8ea0-4ef5-a68f-5cf41b7769f2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:01.121470 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-af588126-8ea0-4ef5-a68f-5cf41b7769f2 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd" status: 200 len: 1368 microversion: 2.1 time: 0.154285 Oct 18 11:46:01.122049 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 351/726] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:00 2022] GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:01.297817 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-99161293-2b93-40ad-a9c9-0534520174e6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:01.298425 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-99161293-2b93-40ad-a9c9-0534520174e6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:01.305336 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-99161293-2b93-40ad-a9c9-0534520174e6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:01.305818 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-99161293-2b93-40ad-a9c9-0534520174e6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:01.306244 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-99161293-2b93-40ad-a9c9-0534520174e6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:01.306927 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-99161293-2b93-40ad-a9c9-0534520174e6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:01.307376 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-99161293-2b93-40ad-a9c9-0534520174e6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:01.307794 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-99161293-2b93-40ad-a9c9-0534520174e6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:01.400187 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-b8c775d3-cbfa-44df-91ba-76e433be9be2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0d10947-081e-47e1-9945-e290f0de5d6e"}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:46:01.402600 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-b8c775d3-cbfa-44df-91ba-76e433be9be2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:01.408500 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b8c775d3-cbfa-44df-91ba-76e433be9be2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:01.409041 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b8c775d3-cbfa-44df-91ba-76e433be9be2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:01.409477 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b8c775d3-cbfa-44df-91ba-76e433be9be2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:01.410170 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b8c775d3-cbfa-44df-91ba-76e433be9be2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:01.411205 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b8c775d3-cbfa-44df-91ba-76e433be9be2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:01.411629 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b8c775d3-cbfa-44df-91ba-76e433be9be2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:01.443548 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-99161293-2b93-40ad-a9c9-0534520174e6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:01.454591 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-99161293-2b93-40ad-a9c9-0534520174e6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1569 microversion: 2.1 time: 0.160607 Oct 18 11:46:01.455179 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 376/727] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:01 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:01.625667 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-ad3c19a1-66b0-4424-9434-061268bca217 req-1f38d94d-3c67-4e82-8c84-4b0d8aa53497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "736e19d9-edb8-4f3d-93c0-0a3e59c395fd", "name": "network-vif-plugged", "status": "completed", "tag": "3c5dcfc4-904b-4c1f-9715-95cec1d6e317"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:46:01.637410 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-ad3c19a1-66b0-4424-9434-061268bca217 req-1f38d94d-3c67-4e82-8c84-4b0d8aa53497 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:01.638277 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-ad3c19a1-66b0-4424-9434-061268bca217 req-1f38d94d-3c67-4e82-8c84-4b0d8aa53497 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:01.638876 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-ad3c19a1-66b0-4424-9434-061268bca217 req-1f38d94d-3c67-4e82-8c84-4b0d8aa53497 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:01.654006 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-ad3c19a1-66b0-4424-9434-061268bca217 req-1f38d94d-3c67-4e82-8c84-4b0d8aa53497 service nova] Creating event network-vif-plugged:3c5dcfc4-904b-4c1f-9715-95cec1d6e317 for instance 736e19d9-edb8-4f3d-93c0-0a3e59c395fd on hv-cinder-81558 Oct 18 11:46:01.661316 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-ad3c19a1-66b0-4424-9434-061268bca217 req-1f38d94d-3c67-4e82-8c84-4b0d8aa53497 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038116 Oct 18 11:46:01.661952 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 377/728] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:46:01.730375 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-b8c775d3-cbfa-44df-91ba-76e433be9be2 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "POST /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333908 Oct 18 11:46:01.731300 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 352/729] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Oct 18 11:46:01 2022] POST /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488/os-volume_attachments => generated 194 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:46:02.144143 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-46db92e2-d5f0-4959-9bba-64fa9cd219db tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:02.144880 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-46db92e2-d5f0-4959-9bba-64fa9cd219db tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 736e19d9-edb8-4f3d-93c0-0a3e59c395fd] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:02.151064 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-46db92e2-d5f0-4959-9bba-64fa9cd219db tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:02.151479 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-46db92e2-d5f0-4959-9bba-64fa9cd219db tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:02.151904 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-46db92e2-d5f0-4959-9bba-64fa9cd219db tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:02.152588 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-46db92e2-d5f0-4959-9bba-64fa9cd219db tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:02.153059 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-46db92e2-d5f0-4959-9bba-64fa9cd219db tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:02.153472 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-46db92e2-d5f0-4959-9bba-64fa9cd219db tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:02.282128 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-46db92e2-d5f0-4959-9bba-64fa9cd219db tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:02.290374 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-46db92e2-d5f0-4959-9bba-64fa9cd219db tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd" status: 200 len: 1368 microversion: 2.1 time: 0.150455 Oct 18 11:46:02.290952 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 378/730] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:02 2022] GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:02.479001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-494ba11c-2344-44c2-8637-170a899afd55 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:02.479610 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-494ba11c-2344-44c2-8637-170a899afd55 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:02.486338 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-494ba11c-2344-44c2-8637-170a899afd55 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:02.486810 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-494ba11c-2344-44c2-8637-170a899afd55 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:02.487236 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-494ba11c-2344-44c2-8637-170a899afd55 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:02.487909 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-494ba11c-2344-44c2-8637-170a899afd55 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:02.488353 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-494ba11c-2344-44c2-8637-170a899afd55 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:02.489440 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-494ba11c-2344-44c2-8637-170a899afd55 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:02.621401 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-494ba11c-2344-44c2-8637-170a899afd55 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:02.629281 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-494ba11c-2344-44c2-8637-170a899afd55 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1569 microversion: 2.1 time: 0.154543 Oct 18 11:46:02.629855 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 353/731] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:02 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:46:03.313693 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-5dbd0b26-33ea-4aff-894b-a12a4cda7c15 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:03.314303 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-5dbd0b26-33ea-4aff-894b-a12a4cda7c15 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 736e19d9-edb8-4f3d-93c0-0a3e59c395fd] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:03.316693 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell0:SELECT=6 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:46:03.317378 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:46:03.323285 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5dbd0b26-33ea-4aff-894b-a12a4cda7c15 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:03.323761 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5dbd0b26-33ea-4aff-894b-a12a4cda7c15 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:03.324194 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5dbd0b26-33ea-4aff-894b-a12a4cda7c15 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:03.324901 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5dbd0b26-33ea-4aff-894b-a12a4cda7c15 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:03.325355 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5dbd0b26-33ea-4aff-894b-a12a4cda7c15 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:03.325777 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5dbd0b26-33ea-4aff-894b-a12a4cda7c15 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:03.456176 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-5dbd0b26-33ea-4aff-894b-a12a4cda7c15 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:03.464324 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-5dbd0b26-33ea-4aff-894b-a12a4cda7c15 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd" status: 200 len: 1368 microversion: 2.1 time: 0.154491 Oct 18 11:46:03.464900 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 379/732] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:03 2022] GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:03.653228 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-0765601f-c6c7-4ea5-ac38-d1061ee9c385 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:03.653838 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-0765601f-c6c7-4ea5-ac38-d1061ee9c385 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:03.655776 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell0:SELECT=2 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:46:03.656421 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell0:SELECT=6 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:46:03.662546 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0765601f-c6c7-4ea5-ac38-d1061ee9c385 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:03.662956 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0765601f-c6c7-4ea5-ac38-d1061ee9c385 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:03.663385 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0765601f-c6c7-4ea5-ac38-d1061ee9c385 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:03.664058 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0765601f-c6c7-4ea5-ac38-d1061ee9c385 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:03.664498 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0765601f-c6c7-4ea5-ac38-d1061ee9c385 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:03.664939 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0765601f-c6c7-4ea5-ac38-d1061ee9c385 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:03.793641 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-0765601f-c6c7-4ea5-ac38-d1061ee9c385 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:03.801284 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-0765601f-c6c7-4ea5-ac38-d1061ee9c385 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1569 microversion: 2.1 time: 0.151852 Oct 18 11:46:03.801845 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 354/733] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:03 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:04.487373 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-71aec170-b322-4d55-95f2-bcf36fb3647e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:04.487987 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-71aec170-b322-4d55-95f2-bcf36fb3647e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 736e19d9-edb8-4f3d-93c0-0a3e59c395fd] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:04.494273 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-71aec170-b322-4d55-95f2-bcf36fb3647e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:04.494749 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-71aec170-b322-4d55-95f2-bcf36fb3647e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:04.495190 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-71aec170-b322-4d55-95f2-bcf36fb3647e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:04.495870 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-71aec170-b322-4d55-95f2-bcf36fb3647e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:04.496314 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-71aec170-b322-4d55-95f2-bcf36fb3647e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:04.496727 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-71aec170-b322-4d55-95f2-bcf36fb3647e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:04.630152 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-71aec170-b322-4d55-95f2-bcf36fb3647e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:04.637704 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-71aec170-b322-4d55-95f2-bcf36fb3647e tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd" status: 200 len: 1368 microversion: 2.1 time: 0.154193 Oct 18 11:46:04.638270 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 380/734] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:04 2022] GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:04.824095 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-482f1508-7dd8-4d5f-8d65-c02089bac85f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:04.824628 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-482f1508-7dd8-4d5f-8d65-c02089bac85f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:04.831309 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-482f1508-7dd8-4d5f-8d65-c02089bac85f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:04.831791 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-482f1508-7dd8-4d5f-8d65-c02089bac85f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:04.832745 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-482f1508-7dd8-4d5f-8d65-c02089bac85f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:04.833488 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-482f1508-7dd8-4d5f-8d65-c02089bac85f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:04.833937 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-482f1508-7dd8-4d5f-8d65-c02089bac85f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:04.834353 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-482f1508-7dd8-4d5f-8d65-c02089bac85f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:04.963743 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-482f1508-7dd8-4d5f-8d65-c02089bac85f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:04.971386 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-482f1508-7dd8-4d5f-8d65-c02089bac85f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1569 microversion: 2.1 time: 0.151252 Oct 18 11:46:04.971935 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 355/735] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:04 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:05.660945 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-a015e320-dd71-43f2-bb6a-38ad6d777a0b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:05.661495 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-a015e320-dd71-43f2-bb6a-38ad6d777a0b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 736e19d9-edb8-4f3d-93c0-0a3e59c395fd] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:05.667804 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a015e320-dd71-43f2-bb6a-38ad6d777a0b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:05.668284 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a015e320-dd71-43f2-bb6a-38ad6d777a0b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:05.668709 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a015e320-dd71-43f2-bb6a-38ad6d777a0b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:05.669427 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a015e320-dd71-43f2-bb6a-38ad6d777a0b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:05.669899 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a015e320-dd71-43f2-bb6a-38ad6d777a0b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:05.670314 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a015e320-dd71-43f2-bb6a-38ad6d777a0b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:05.800262 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-a015e320-dd71-43f2-bb6a-38ad6d777a0b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:05.807918 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-a015e320-dd71-43f2-bb6a-38ad6d777a0b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd" status: 200 len: 1368 microversion: 2.1 time: 0.150872 Oct 18 11:46:05.808486 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 381/736] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:05 2022] GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:05.994669 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-5d676963-c7e3-4a66-bb77-f0011026d329 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:05.995272 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-5d676963-c7e3-4a66-bb77-f0011026d329 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:06.001660 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5d676963-c7e3-4a66-bb77-f0011026d329 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:06.002123 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5d676963-c7e3-4a66-bb77-f0011026d329 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:06.002546 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5d676963-c7e3-4a66-bb77-f0011026d329 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:06.003235 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5d676963-c7e3-4a66-bb77-f0011026d329 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:06.003675 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5d676963-c7e3-4a66-bb77-f0011026d329 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:06.004603 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-5d676963-c7e3-4a66-bb77-f0011026d329 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:06.124907 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-6fa2cda0-9e86-4525-8698-62439f2c0778 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:06.125391 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-6fa2cda0-9e86-4525-8698-62439f2c0778 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:06.131812 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6fa2cda0-9e86-4525-8698-62439f2c0778 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:06.132409 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6fa2cda0-9e86-4525-8698-62439f2c0778 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:06.132851 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6fa2cda0-9e86-4525-8698-62439f2c0778 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:06.133589 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6fa2cda0-9e86-4525-8698-62439f2c0778 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:06.134048 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6fa2cda0-9e86-4525-8698-62439f2c0778 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:06.134593 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6fa2cda0-9e86-4525-8698-62439f2c0778 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:06.151187 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-5d676963-c7e3-4a66-bb77-f0011026d329 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:06.159010 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-5d676963-c7e3-4a66-bb77-f0011026d329 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1569 microversion: 2.1 time: 0.168050 Oct 18 11:46:06.159586 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 356/737] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:05 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:06.166403 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-6fa2cda0-9e86-4525-8698-62439f2c0778 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe/ips" status: 200 len: 152 microversion: 2.20 time: 0.044184 Oct 18 11:46:06.166403 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 382/738] 10.222.0.17 () {60 vars in 1289 bytes} [Tue Oct 18 11:46:06 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe/ips => generated 152 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 11:46:06.831241 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-d854dd08-c4f5-4e63-8393-c55deecff898 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:06.831766 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-d854dd08-c4f5-4e63-8393-c55deecff898 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 736e19d9-edb8-4f3d-93c0-0a3e59c395fd] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:06.837917 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d854dd08-c4f5-4e63-8393-c55deecff898 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:06.838344 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d854dd08-c4f5-4e63-8393-c55deecff898 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:06.838766 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d854dd08-c4f5-4e63-8393-c55deecff898 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:06.839440 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d854dd08-c4f5-4e63-8393-c55deecff898 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:06.839884 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d854dd08-c4f5-4e63-8393-c55deecff898 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:06.840296 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d854dd08-c4f5-4e63-8393-c55deecff898 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:06.974652 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-d854dd08-c4f5-4e63-8393-c55deecff898 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:06.982706 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-d854dd08-c4f5-4e63-8393-c55deecff898 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd" status: 200 len: 1557 microversion: 2.1 time: 0.155662 Oct 18 11:46:06.983278 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 357/739] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:06 2022] GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:07.005268 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-3559f7bb-c2b5-4335-9b9a-599b4d05a076 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:07.005774 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-3559f7bb-c2b5-4335-9b9a-599b4d05a076 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 736e19d9-edb8-4f3d-93c0-0a3e59c395fd] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:07.012269 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3559f7bb-c2b5-4335-9b9a-599b4d05a076 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:07.012747 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3559f7bb-c2b5-4335-9b9a-599b4d05a076 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:07.013207 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3559f7bb-c2b5-4335-9b9a-599b4d05a076 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:07.013888 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3559f7bb-c2b5-4335-9b9a-599b4d05a076 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:07.014337 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3559f7bb-c2b5-4335-9b9a-599b4d05a076 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:07.014756 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3559f7bb-c2b5-4335-9b9a-599b4d05a076 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:07.094527 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-3559f7bb-c2b5-4335-9b9a-599b4d05a076 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093006 Oct 18 11:46:07.095242 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 383/740] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Oct 18 11:46:07 2022] GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:46:07.189228 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-a31f3cc6-f0ce-4797-b2e1-55a11e60a04b tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:07.189841 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-a31f3cc6-f0ce-4797-b2e1-55a11e60a04b tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:07.196417 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a31f3cc6-f0ce-4797-b2e1-55a11e60a04b tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:07.196933 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a31f3cc6-f0ce-4797-b2e1-55a11e60a04b tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:07.197372 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a31f3cc6-f0ce-4797-b2e1-55a11e60a04b tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:07.198061 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a31f3cc6-f0ce-4797-b2e1-55a11e60a04b tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:07.198507 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a31f3cc6-f0ce-4797-b2e1-55a11e60a04b tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:07.198924 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a31f3cc6-f0ce-4797-b2e1-55a11e60a04b tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:07.343562 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-a31f3cc6-f0ce-4797-b2e1-55a11e60a04b tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:07.355256 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-a31f3cc6-f0ce-4797-b2e1-55a11e60a04b tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1569 microversion: 2.1 time: 0.169752 Oct 18 11:46:07.356172 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 358/741] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:07 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:08.135331 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-1935e2ce-1e33-4904-badb-6b09503123c1 req-ace8eeab-786f-483f-bf6d-68c362e79b17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "736e19d9-edb8-4f3d-93c0-0a3e59c395fd", "tag": "3c5dcfc4-904b-4c1f-9715-95cec1d6e317"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:46:08.146203 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-1935e2ce-1e33-4904-badb-6b09503123c1 req-ace8eeab-786f-483f-bf6d-68c362e79b17 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:08.146613 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-1935e2ce-1e33-4904-badb-6b09503123c1 req-ace8eeab-786f-483f-bf6d-68c362e79b17 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:08.147080 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-1935e2ce-1e33-4904-badb-6b09503123c1 req-ace8eeab-786f-483f-bf6d-68c362e79b17 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:08.160620 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-1935e2ce-1e33-4904-badb-6b09503123c1 req-ace8eeab-786f-483f-bf6d-68c362e79b17 service nova] Creating event network-changed:3c5dcfc4-904b-4c1f-9715-95cec1d6e317 for instance 736e19d9-edb8-4f3d-93c0-0a3e59c395fd on hv-cinder-81558 Oct 18 11:46:08.166462 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-1935e2ce-1e33-4904-badb-6b09503123c1 req-ace8eeab-786f-483f-bf6d-68c362e79b17 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095893 Oct 18 11:46:08.167205 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 384/742] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:46:08.175445 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-9a45e18e-ae53-40c5-bf81-3eadc9d0bb2f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:46:08.176577 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-9a45e18e-ae53-40c5-bf81-3eadc9d0bb2f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:08.184096 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9a45e18e-ae53-40c5-bf81-3eadc9d0bb2f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:08.184587 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9a45e18e-ae53-40c5-bf81-3eadc9d0bb2f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:08.185055 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9a45e18e-ae53-40c5-bf81-3eadc9d0bb2f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:08.185873 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9a45e18e-ae53-40c5-bf81-3eadc9d0bb2f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:08.186197 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9a45e18e-ae53-40c5-bf81-3eadc9d0bb2f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:08.186623 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9a45e18e-ae53-40c5-bf81-3eadc9d0bb2f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:08.211380 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.objects.instance [None req-9a45e18e-ae53-40c5-bf81-3eadc9d0bb2f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lazy-loading 'flavor' on Instance uuid bb2ccf2c-f9af-4953-90e6-88ab81961afe {{(pid=125486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:46:08.240137 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:46:08.380470 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-52e7b771-725c-4a09-a69a-95f3cf1358dd tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:08.381420 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-52e7b771-725c-4a09-a69a-95f3cf1358dd tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:08.388153 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-52e7b771-725c-4a09-a69a-95f3cf1358dd tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:08.388962 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-52e7b771-725c-4a09-a69a-95f3cf1358dd tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:08.389587 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-52e7b771-725c-4a09-a69a-95f3cf1358dd tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:08.390460 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-52e7b771-725c-4a09-a69a-95f3cf1358dd tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:08.391211 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-52e7b771-725c-4a09-a69a-95f3cf1358dd tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:08.391636 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-52e7b771-725c-4a09-a69a-95f3cf1358dd tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:08.415050 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-9a45e18e-ae53-40c5-bf81-3eadc9d0bb2f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "POST /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe/action" status: 202 len: 0 microversion: 2.20 time: 0.243404 Oct 18 11:46:08.419203 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 359/743] 10.222.0.17 () {62 vars in 1319 bytes} [Tue Oct 18 11:46:08 2022] POST /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 11:46:08.424730 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-d022e73a-e763-4659-9df3-0f9a51835385 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:08.425648 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-d022e73a-e763-4659-9df3-0f9a51835385 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:08.433154 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d022e73a-e763-4659-9df3-0f9a51835385 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:08.433636 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d022e73a-e763-4659-9df3-0f9a51835385 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:08.434257 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d022e73a-e763-4659-9df3-0f9a51835385 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:08.434950 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d022e73a-e763-4659-9df3-0f9a51835385 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:08.435398 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d022e73a-e763-4659-9df3-0f9a51835385 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:08.435991 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d022e73a-e763-4659-9df3-0f9a51835385 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:08.542916 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-52e7b771-725c-4a09-a69a-95f3cf1358dd tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:08.551607 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-52e7b771-725c-4a09-a69a-95f3cf1358dd tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1569 microversion: 2.1 time: 0.175910 Oct 18 11:46:08.552189 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 385/744] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:08 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:08.576221 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-d022e73a-e763-4659-9df3-0f9a51835385 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:08.585485 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-d022e73a-e763-4659-9df3-0f9a51835385 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:08.587028 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-d022e73a-e763-4659-9df3-0f9a51835385 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:08.588107 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-d022e73a-e763-4659-9df3-0f9a51835385 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1721 microversion: 2.20 time: 0.167601 Oct 18 11:46:08.588665 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 360/745] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:08 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:46:09.578227 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-5ec4ae50-94f5-44de-9a7a-829c28bf1f84 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:09.578751 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-5ec4ae50-94f5-44de-9a7a-829c28bf1f84 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:09.585853 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5ec4ae50-94f5-44de-9a7a-829c28bf1f84 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:09.586323 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5ec4ae50-94f5-44de-9a7a-829c28bf1f84 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:09.586745 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5ec4ae50-94f5-44de-9a7a-829c28bf1f84 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:09.587423 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5ec4ae50-94f5-44de-9a7a-829c28bf1f84 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:09.587891 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5ec4ae50-94f5-44de-9a7a-829c28bf1f84 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:09.588334 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5ec4ae50-94f5-44de-9a7a-829c28bf1f84 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:09.614962 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-de328a01-68f7-49fc-923f-90f5ac3c2cad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:09.615727 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-de328a01-68f7-49fc-923f-90f5ac3c2cad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:09.618565 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:46:09.624890 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-de328a01-68f7-49fc-923f-90f5ac3c2cad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:09.625371 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-de328a01-68f7-49fc-923f-90f5ac3c2cad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:09.625806 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-de328a01-68f7-49fc-923f-90f5ac3c2cad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:09.626506 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-de328a01-68f7-49fc-923f-90f5ac3c2cad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:09.626956 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-de328a01-68f7-49fc-923f-90f5ac3c2cad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:09.627383 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-de328a01-68f7-49fc-923f-90f5ac3c2cad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:09.728193 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-5ec4ae50-94f5-44de-9a7a-829c28bf1f84 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:09.736179 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-5ec4ae50-94f5-44de-9a7a-829c28bf1f84 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1569 microversion: 2.1 time: 0.161755 Oct 18 11:46:09.736757 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 386/746] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:09 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:09.764124 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-de328a01-68f7-49fc-923f-90f5ac3c2cad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:09.772934 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-de328a01-68f7-49fc-923f-90f5ac3c2cad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:09.774413 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-de328a01-68f7-49fc-923f-90f5ac3c2cad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:09.775579 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-de328a01-68f7-49fc-923f-90f5ac3c2cad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1721 microversion: 2.20 time: 0.164744 Oct 18 11:46:09.776137 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 361/747] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:09 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:46:10.762125 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-9caa27a2-9832-4b06-9a61-fa79319a12ab tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:10.762667 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-9caa27a2-9832-4b06-9a61-fa79319a12ab tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:10.768962 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9caa27a2-9832-4b06-9a61-fa79319a12ab tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:10.769995 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9caa27a2-9832-4b06-9a61-fa79319a12ab tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:10.770591 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9caa27a2-9832-4b06-9a61-fa79319a12ab tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:10.771265 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9caa27a2-9832-4b06-9a61-fa79319a12ab tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:10.771708 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9caa27a2-9832-4b06-9a61-fa79319a12ab tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:10.772120 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9caa27a2-9832-4b06-9a61-fa79319a12ab tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:10.801237 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-cebdf256-be0f-4f61-9bd6-67c66c905663 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:10.801933 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-cebdf256-be0f-4f61-9bd6-67c66c905663 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:10.808516 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cebdf256-be0f-4f61-9bd6-67c66c905663 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:10.809128 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cebdf256-be0f-4f61-9bd6-67c66c905663 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:10.809635 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cebdf256-be0f-4f61-9bd6-67c66c905663 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:10.810428 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cebdf256-be0f-4f61-9bd6-67c66c905663 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:10.810915 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cebdf256-be0f-4f61-9bd6-67c66c905663 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:10.811451 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cebdf256-be0f-4f61-9bd6-67c66c905663 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:10.905276 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-9caa27a2-9832-4b06-9a61-fa79319a12ab tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:10.914381 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-9caa27a2-9832-4b06-9a61-fa79319a12ab tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1569 microversion: 2.1 time: 0.156106 Oct 18 11:46:10.915318 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 387/748] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:10 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:10.998745 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-cebdf256-be0f-4f61-9bd6-67c66c905663 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:11.007927 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-cebdf256-be0f-4f61-9bd6-67c66c905663 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:11.009554 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-cebdf256-be0f-4f61-9bd6-67c66c905663 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:11.010633 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-cebdf256-be0f-4f61-9bd6-67c66c905663 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1721 microversion: 2.20 time: 0.213894 Oct 18 11:46:11.011188 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 362/749] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:10 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:46:11.938701 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-958323b4-ea18-4997-85ed-5d3515694c59 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:11.939441 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-958323b4-ea18-4997-85ed-5d3515694c59 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:11.948416 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-958323b4-ea18-4997-85ed-5d3515694c59 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:11.949210 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-958323b4-ea18-4997-85ed-5d3515694c59 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:11.949729 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-958323b4-ea18-4997-85ed-5d3515694c59 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:11.950752 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-958323b4-ea18-4997-85ed-5d3515694c59 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:11.951229 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-958323b4-ea18-4997-85ed-5d3515694c59 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:11.951647 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-958323b4-ea18-4997-85ed-5d3515694c59 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:12.035989 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-0dfefe48-b62d-499d-9125-137d4a2add3d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:12.036594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-0dfefe48-b62d-499d-9125-137d4a2add3d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:12.043060 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0dfefe48-b62d-499d-9125-137d4a2add3d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:12.043536 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0dfefe48-b62d-499d-9125-137d4a2add3d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:12.043970 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0dfefe48-b62d-499d-9125-137d4a2add3d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:12.044865 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0dfefe48-b62d-499d-9125-137d4a2add3d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:12.045320 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0dfefe48-b62d-499d-9125-137d4a2add3d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:12.045731 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0dfefe48-b62d-499d-9125-137d4a2add3d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:12.092735 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-958323b4-ea18-4997-85ed-5d3515694c59 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:12.100751 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-958323b4-ea18-4997-85ed-5d3515694c59 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1569 microversion: 2.1 time: 0.166218 Oct 18 11:46:12.101446 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 388/750] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:11 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:12.175011 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-0dfefe48-b62d-499d-9125-137d4a2add3d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:12.183142 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-0dfefe48-b62d-499d-9125-137d4a2add3d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:12.184571 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-0dfefe48-b62d-499d-9125-137d4a2add3d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:12.185748 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-0dfefe48-b62d-499d-9125-137d4a2add3d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1721 microversion: 2.20 time: 0.154015 Oct 18 11:46:12.186295 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 363/751] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:12 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:46:12.468328 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-d169050f-a8da-4bcd-b19b-b746f31fc485 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:12.470486 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-d169050f-a8da-4bcd-b19b-b746f31fc485 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:12.476313 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d169050f-a8da-4bcd-b19b-b746f31fc485 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:12.476790 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d169050f-a8da-4bcd-b19b-b746f31fc485 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:12.477255 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d169050f-a8da-4bcd-b19b-b746f31fc485 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:12.477930 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d169050f-a8da-4bcd-b19b-b746f31fc485 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:12.478376 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d169050f-a8da-4bcd-b19b-b746f31fc485 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:12.478795 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d169050f-a8da-4bcd-b19b-b746f31fc485 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:12.508442 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-d169050f-a8da-4bcd-b19b-b746f31fc485 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043962 Oct 18 11:46:12.509037 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 389/752] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Oct 18 11:46:12 2022] GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:46:12.519482 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-85990a7a-eb8e-4b40-91ba-433613dbd1d1 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:12.519975 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-85990a7a-eb8e-4b40-91ba-433613dbd1d1 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:12.525888 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-85990a7a-eb8e-4b40-91ba-433613dbd1d1 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:12.526366 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-85990a7a-eb8e-4b40-91ba-433613dbd1d1 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:12.526796 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-85990a7a-eb8e-4b40-91ba-433613dbd1d1 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:12.527478 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-85990a7a-eb8e-4b40-91ba-433613dbd1d1 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:12.527932 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-85990a7a-eb8e-4b40-91ba-433613dbd1d1 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:12.528350 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-85990a7a-eb8e-4b40-91ba-433613dbd1d1 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:12.559752 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-85990a7a-eb8e-4b40-91ba-433613dbd1d1 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488/os-volume_attachments/c0d10947-081e-47e1-9945-e290f0de5d6e" status: 200 len: 194 microversion: 2.1 time: 0.044144 Oct 18 11:46:12.564046 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 364/753] 10.222.0.17 () {58 vars in 1413 bytes} [Tue Oct 18 11:46:12 2022] GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488/os-volume_attachments/c0d10947-081e-47e1-9945-e290f0de5d6e => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:46:13.124056 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-144b7a2f-09ae-4ae2-816c-442b9e74f660 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:13.124664 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-144b7a2f-09ae-4ae2-816c-442b9e74f660 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:13.131909 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-144b7a2f-09ae-4ae2-816c-442b9e74f660 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:13.132428 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-144b7a2f-09ae-4ae2-816c-442b9e74f660 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:13.132964 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-144b7a2f-09ae-4ae2-816c-442b9e74f660 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:13.133742 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-144b7a2f-09ae-4ae2-816c-442b9e74f660 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:13.134208 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-144b7a2f-09ae-4ae2-816c-442b9e74f660 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:13.134731 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-144b7a2f-09ae-4ae2-816c-442b9e74f660 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:13.211518 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-581de02c-13dd-4447-95bd-17e04cb23c46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:13.212108 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-581de02c-13dd-4447-95bd-17e04cb23c46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:13.219362 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-581de02c-13dd-4447-95bd-17e04cb23c46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:13.219966 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-581de02c-13dd-4447-95bd-17e04cb23c46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:13.220402 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-581de02c-13dd-4447-95bd-17e04cb23c46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:13.221132 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-581de02c-13dd-4447-95bd-17e04cb23c46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:13.221579 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-581de02c-13dd-4447-95bd-17e04cb23c46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:13.221995 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-581de02c-13dd-4447-95bd-17e04cb23c46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:13.267379 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-144b7a2f-09ae-4ae2-816c-442b9e74f660 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:13.272733 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=100 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:46:13.278225 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-144b7a2f-09ae-4ae2-816c-442b9e74f660 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1569 microversion: 2.1 time: 0.158077 Oct 18 11:46:13.286723 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 390/754] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:13 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:46:13.356598 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-581de02c-13dd-4447-95bd-17e04cb23c46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:13.365097 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-581de02c-13dd-4447-95bd-17e04cb23c46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:13.366528 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-581de02c-13dd-4447-95bd-17e04cb23c46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:13.367677 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-581de02c-13dd-4447-95bd-17e04cb23c46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1721 microversion: 2.20 time: 0.160113 Oct 18 11:46:13.368262 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 365/755] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:13 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:46:13.894107 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-91be5019-ec9f-404f-b210-1bf95ebd1855 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8647df0c-03b7-4c66-ab42-54a2915a384d"}} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:46:13.896402 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-91be5019-ec9f-404f-b210-1bf95ebd1855 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:13.902800 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-91be5019-ec9f-404f-b210-1bf95ebd1855 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:13.903270 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-91be5019-ec9f-404f-b210-1bf95ebd1855 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:13.903695 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-91be5019-ec9f-404f-b210-1bf95ebd1855 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:13.904372 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-91be5019-ec9f-404f-b210-1bf95ebd1855 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:13.904818 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-91be5019-ec9f-404f-b210-1bf95ebd1855 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:13.905244 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-91be5019-ec9f-404f-b210-1bf95ebd1855 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:14.302197 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-c56e1b27-72b8-4dd7-a623-b81ea1c49e1f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:14.302829 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-c56e1b27-72b8-4dd7-a623-b81ea1c49e1f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:14.309425 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c56e1b27-72b8-4dd7-a623-b81ea1c49e1f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:14.309903 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c56e1b27-72b8-4dd7-a623-b81ea1c49e1f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:14.310333 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c56e1b27-72b8-4dd7-a623-b81ea1c49e1f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:14.311009 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c56e1b27-72b8-4dd7-a623-b81ea1c49e1f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:14.311458 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c56e1b27-72b8-4dd7-a623-b81ea1c49e1f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:14.311871 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c56e1b27-72b8-4dd7-a623-b81ea1c49e1f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:14.441547 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-c56e1b27-72b8-4dd7-a623-b81ea1c49e1f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:14.449259 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-c56e1b27-72b8-4dd7-a623-b81ea1c49e1f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1569 microversion: 2.1 time: 0.151479 Oct 18 11:46:14.449827 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 366/756] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:14 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:46:14.454583 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-7799216e-b53e-41e1-980c-3850bf56c78b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:14.455457 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-7799216e-b53e-41e1-980c-3850bf56c78b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:14.461940 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7799216e-b53e-41e1-980c-3850bf56c78b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:14.462401 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7799216e-b53e-41e1-980c-3850bf56c78b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:14.462829 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7799216e-b53e-41e1-980c-3850bf56c78b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:14.463512 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7799216e-b53e-41e1-980c-3850bf56c78b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:14.463959 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7799216e-b53e-41e1-980c-3850bf56c78b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:14.464376 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7799216e-b53e-41e1-980c-3850bf56c78b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:14.594525 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-7799216e-b53e-41e1-980c-3850bf56c78b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:14.603030 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-7799216e-b53e-41e1-980c-3850bf56c78b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:14.604515 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-7799216e-b53e-41e1-980c-3850bf56c78b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:14.605718 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-7799216e-b53e-41e1-980c-3850bf56c78b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1721 microversion: 2.20 time: 0.154993 Oct 18 11:46:14.606282 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 367/757] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:14 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:46:15.473777 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-17bb8c25-1232-4714-9a14-5a0090bab724 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:15.474390 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-17bb8c25-1232-4714-9a14-5a0090bab724 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:15.480630 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-17bb8c25-1232-4714-9a14-5a0090bab724 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:15.481136 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-17bb8c25-1232-4714-9a14-5a0090bab724 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:15.481564 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-17bb8c25-1232-4714-9a14-5a0090bab724 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:15.482236 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-17bb8c25-1232-4714-9a14-5a0090bab724 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:15.482678 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-17bb8c25-1232-4714-9a14-5a0090bab724 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:15.483088 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-17bb8c25-1232-4714-9a14-5a0090bab724 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:15.610657 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-17bb8c25-1232-4714-9a14-5a0090bab724 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:15.619074 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-17bb8c25-1232-4714-9a14-5a0090bab724 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1569 microversion: 2.1 time: 0.149297 Oct 18 11:46:15.619626 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 368/758] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:15 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:46:15.631877 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-d8b7918b-b9a9-4262-b43b-940bd43a679a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:15.632564 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-d8b7918b-b9a9-4262-b43b-940bd43a679a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:15.638551 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d8b7918b-b9a9-4262-b43b-940bd43a679a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:15.639036 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d8b7918b-b9a9-4262-b43b-940bd43a679a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:15.639473 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d8b7918b-b9a9-4262-b43b-940bd43a679a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:15.640163 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d8b7918b-b9a9-4262-b43b-940bd43a679a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:15.640612 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d8b7918b-b9a9-4262-b43b-940bd43a679a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:15.641068 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d8b7918b-b9a9-4262-b43b-940bd43a679a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:15.769193 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-d8b7918b-b9a9-4262-b43b-940bd43a679a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:15.777153 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-d8b7918b-b9a9-4262-b43b-940bd43a679a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:15.778572 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-d8b7918b-b9a9-4262-b43b-940bd43a679a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:15.779712 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-d8b7918b-b9a9-4262-b43b-940bd43a679a tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1721 microversion: 2.20 time: 0.152231 Oct 18 11:46:15.780265 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 369/759] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:15 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:46:16.334335 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-91be5019-ec9f-404f-b210-1bf95ebd1855 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "POST /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.444003 Oct 18 11:46:16.334946 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 391/760] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Oct 18 11:46:13 2022] POST /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488/os-volume_attachments => generated 194 bytes in 2445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:46:16.643237 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-09af3ceb-e41c-4397-a0e5-23c67e55812e tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:16.643885 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-09af3ceb-e41c-4397-a0e5-23c67e55812e tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:16.650961 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-09af3ceb-e41c-4397-a0e5-23c67e55812e tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:16.651447 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-09af3ceb-e41c-4397-a0e5-23c67e55812e tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:16.651881 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-09af3ceb-e41c-4397-a0e5-23c67e55812e tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:16.652571 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-09af3ceb-e41c-4397-a0e5-23c67e55812e tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:16.653060 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-09af3ceb-e41c-4397-a0e5-23c67e55812e tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:16.653486 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-09af3ceb-e41c-4397-a0e5-23c67e55812e tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:16.782703 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-09af3ceb-e41c-4397-a0e5-23c67e55812e tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:16.790483 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-09af3ceb-e41c-4397-a0e5-23c67e55812e tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1569 microversion: 2.1 time: 0.151114 Oct 18 11:46:16.791049 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 370/761] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:16 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:16.809941 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-cfb97524-2941-4d32-b887-1fdbb343f1f5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:16.810880 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-cfb97524-2941-4d32-b887-1fdbb343f1f5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:16.817558 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cfb97524-2941-4d32-b887-1fdbb343f1f5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:16.818045 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cfb97524-2941-4d32-b887-1fdbb343f1f5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:16.818464 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cfb97524-2941-4d32-b887-1fdbb343f1f5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:16.819152 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cfb97524-2941-4d32-b887-1fdbb343f1f5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:16.819597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cfb97524-2941-4d32-b887-1fdbb343f1f5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:16.820013 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cfb97524-2941-4d32-b887-1fdbb343f1f5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:16.965266 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-cfb97524-2941-4d32-b887-1fdbb343f1f5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:16.976246 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-cfb97524-2941-4d32-b887-1fdbb343f1f5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:16.978414 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-cfb97524-2941-4d32-b887-1fdbb343f1f5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:16.979996 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-cfb97524-2941-4d32-b887-1fdbb343f1f5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1721 microversion: 2.20 time: 0.174770 Oct 18 11:46:16.980521 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 392/762] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:16 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:46:17.814486 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-765de48b-2f45-4dce-b070-b9b75ac93dd4 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:17.815090 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-765de48b-2f45-4dce-b070-b9b75ac93dd4 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:17.821536 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-765de48b-2f45-4dce-b070-b9b75ac93dd4 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:17.822019 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-765de48b-2f45-4dce-b070-b9b75ac93dd4 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:17.822448 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-765de48b-2f45-4dce-b070-b9b75ac93dd4 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:17.823125 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-765de48b-2f45-4dce-b070-b9b75ac93dd4 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:17.823573 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-765de48b-2f45-4dce-b070-b9b75ac93dd4 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:17.823988 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-765de48b-2f45-4dce-b070-b9b75ac93dd4 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:17.957983 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-765de48b-2f45-4dce-b070-b9b75ac93dd4 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:17.966261 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-765de48b-2f45-4dce-b070-b9b75ac93dd4 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1510 microversion: 2.1 time: 0.155633 Oct 18 11:46:17.966820 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 371/763] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:17 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:17.988336 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ab53382f-deee-4b6e-b043-574c59ef16e3 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:46:17.988946 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-ab53382f-deee-4b6e-b043-574c59ef16e3 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:17.995659 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ab53382f-deee-4b6e-b043-574c59ef16e3 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:17.996158 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ab53382f-deee-4b6e-b043-574c59ef16e3 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:17.996581 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ab53382f-deee-4b6e-b043-574c59ef16e3 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:17.997308 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ab53382f-deee-4b6e-b043-574c59ef16e3 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:17.997748 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ab53382f-deee-4b6e-b043-574c59ef16e3 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:17.998158 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ab53382f-deee-4b6e-b043-574c59ef16e3 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:18.006161 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-e866ba6a-5fbe-4b52-91d1-b8ef8f4771f9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:18.006767 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-e866ba6a-5fbe-4b52-91d1-b8ef8f4771f9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:18.012602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e866ba6a-5fbe-4b52-91d1-b8ef8f4771f9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:18.013118 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e866ba6a-5fbe-4b52-91d1-b8ef8f4771f9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:18.013552 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e866ba6a-5fbe-4b52-91d1-b8ef8f4771f9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:18.014246 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e866ba6a-5fbe-4b52-91d1-b8ef8f4771f9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:18.014695 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e866ba6a-5fbe-4b52-91d1-b8ef8f4771f9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:18.015112 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e866ba6a-5fbe-4b52-91d1-b8ef8f4771f9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:18.028837 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-ab53382f-deee-4b6e-b043-574c59ef16e3 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125485) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 18 11:46:18.107227 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-ab53382f-deee-4b6e-b043-574c59ef16e3 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "POST /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01/action" status: 202 len: 0 microversion: 2.1 time: 0.122548 Oct 18 11:46:18.111224 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 393/764] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Oct 18 11:46:17 2022] POST /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 11:46:18.116723 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-44e8ae07-8e14-4925-bc5e-e3874e228766 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:18.117387 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-44e8ae07-8e14-4925-bc5e-e3874e228766 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:18.123943 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-44e8ae07-8e14-4925-bc5e-e3874e228766 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:18.124476 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-44e8ae07-8e14-4925-bc5e-e3874e228766 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:18.124933 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-44e8ae07-8e14-4925-bc5e-e3874e228766 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:18.125635 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-44e8ae07-8e14-4925-bc5e-e3874e228766 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:18.126092 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-44e8ae07-8e14-4925-bc5e-e3874e228766 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:18.126521 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-44e8ae07-8e14-4925-bc5e-e3874e228766 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:18.273289 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-44e8ae07-8e14-4925-bc5e-e3874e228766 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:18.281781 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-44e8ae07-8e14-4925-bc5e-e3874e228766 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1518 microversion: 2.1 time: 0.169503 Oct 18 11:46:18.282459 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 394/765] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:18 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:18.319005 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-e866ba6a-5fbe-4b52-91d1-b8ef8f4771f9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:18.327567 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-e866ba6a-5fbe-4b52-91d1-b8ef8f4771f9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:18.329019 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-e866ba6a-5fbe-4b52-91d1-b8ef8f4771f9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:18.330531 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-e866ba6a-5fbe-4b52-91d1-b8ef8f4771f9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1721 microversion: 2.20 time: 0.328500 Oct 18 11:46:18.331091 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 372/766] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:18 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1721 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:46:19.307074 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-af340ad9-0262-483a-b9c6-6f6e8e0c76d6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:19.307696 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-af340ad9-0262-483a-b9c6-6f6e8e0c76d6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:19.314043 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-af340ad9-0262-483a-b9c6-6f6e8e0c76d6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:19.314515 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-af340ad9-0262-483a-b9c6-6f6e8e0c76d6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:19.314939 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-af340ad9-0262-483a-b9c6-6f6e8e0c76d6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:19.315610 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-af340ad9-0262-483a-b9c6-6f6e8e0c76d6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:19.316052 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-af340ad9-0262-483a-b9c6-6f6e8e0c76d6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:19.316461 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-af340ad9-0262-483a-b9c6-6f6e8e0c76d6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:19.356822 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-fb6b2846-d749-49ef-8690-baafdca47bcc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:19.357380 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-fb6b2846-d749-49ef-8690-baafdca47bcc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:19.363815 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fb6b2846-d749-49ef-8690-baafdca47bcc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:19.364300 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fb6b2846-d749-49ef-8690-baafdca47bcc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:19.365336 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fb6b2846-d749-49ef-8690-baafdca47bcc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:19.366046 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fb6b2846-d749-49ef-8690-baafdca47bcc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:19.366496 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fb6b2846-d749-49ef-8690-baafdca47bcc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:19.366918 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fb6b2846-d749-49ef-8690-baafdca47bcc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:19.465539 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-af340ad9-0262-483a-b9c6-6f6e8e0c76d6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:19.473219 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-af340ad9-0262-483a-b9c6-6f6e8e0c76d6 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1520 microversion: 2.1 time: 0.169958 Oct 18 11:46:19.474515 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 395/767] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:19 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:19.504180 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-fb6b2846-d749-49ef-8690-baafdca47bcc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:19.512307 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-fb6b2846-d749-49ef-8690-baafdca47bcc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:19.513743 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-fb6b2846-d749-49ef-8690-baafdca47bcc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:19.514897 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-fb6b2846-d749-49ef-8690-baafdca47bcc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1721 microversion: 2.20 time: 0.162090 Oct 18 11:46:19.515443 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 373/768] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:19 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:46:20.497198 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-90b6b595-2166-401b-8ee3-06f4fab24929 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:20.497769 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-90b6b595-2166-401b-8ee3-06f4fab24929 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:20.504122 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-90b6b595-2166-401b-8ee3-06f4fab24929 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:20.504601 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-90b6b595-2166-401b-8ee3-06f4fab24929 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:20.505071 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-90b6b595-2166-401b-8ee3-06f4fab24929 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:20.506405 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-90b6b595-2166-401b-8ee3-06f4fab24929 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:20.506866 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-90b6b595-2166-401b-8ee3-06f4fab24929 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:20.507284 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-90b6b595-2166-401b-8ee3-06f4fab24929 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:20.539141 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-9dcf5fd7-101f-4389-88b9-918b37dedaa3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:20.539837 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-9dcf5fd7-101f-4389-88b9-918b37dedaa3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:20.546411 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9dcf5fd7-101f-4389-88b9-918b37dedaa3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:20.546894 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9dcf5fd7-101f-4389-88b9-918b37dedaa3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:20.547326 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9dcf5fd7-101f-4389-88b9-918b37dedaa3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:20.548227 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9dcf5fd7-101f-4389-88b9-918b37dedaa3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:20.548683 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9dcf5fd7-101f-4389-88b9-918b37dedaa3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:20.549129 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9dcf5fd7-101f-4389-88b9-918b37dedaa3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:20.641630 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-90b6b595-2166-401b-8ee3-06f4fab24929 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:20.649683 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-90b6b595-2166-401b-8ee3-06f4fab24929 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1520 microversion: 2.1 time: 0.156410 Oct 18 11:46:20.650256 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 396/769] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:20 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:20.695188 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-9dcf5fd7-101f-4389-88b9-918b37dedaa3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:20.705822 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-9dcf5fd7-101f-4389-88b9-918b37dedaa3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:20.707428 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-9dcf5fd7-101f-4389-88b9-918b37dedaa3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:20.708676 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-9dcf5fd7-101f-4389-88b9-918b37dedaa3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1721 microversion: 2.20 time: 0.173396 Oct 18 11:46:20.728685 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 374/770] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:20 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:46:20.861343 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-c6b5c92a-6153-4dff-a882-1f567807101f req-ffb3caf2-3540-4ce7-b754-f1043fdf98c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29b0847b-6a68-4b35-91d4-1ce725985f01", "name": "network-vif-unplugged", "status": "completed", "tag": "ffd48d58-8fbc-42a2-a002-1687b4c71e8e"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:46:20.871534 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-c6b5c92a-6153-4dff-a882-1f567807101f req-ffb3caf2-3540-4ce7-b754-f1043fdf98c0 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:20.871961 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-c6b5c92a-6153-4dff-a882-1f567807101f req-ffb3caf2-3540-4ce7-b754-f1043fdf98c0 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:20.872390 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-c6b5c92a-6153-4dff-a882-1f567807101f req-ffb3caf2-3540-4ce7-b754-f1043fdf98c0 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:20.883300 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.compute.server_external_events [req-c6b5c92a-6153-4dff-a882-1f567807101f req-ffb3caf2-3540-4ce7-b754-f1043fdf98c0 service nova] Unable to find a host for instance 29b0847b-6a68-4b35-91d4-1ce725985f01. Dropping event network-vif-unplugged {{(pid=125485) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 18 11:46:20.884183 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-c6b5c92a-6153-4dff-a882-1f567807101f req-ffb3caf2-3540-4ce7-b754-f1043fdf98c0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.081792 Oct 18 11:46:20.884947 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 397/771] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 83 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 18 11:46:21.672759 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-fc6cc222-decb-450a-8365-ccc0f93559da tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:21.673407 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-fc6cc222-decb-450a-8365-ccc0f93559da tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:21.680628 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fc6cc222-decb-450a-8365-ccc0f93559da tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:21.681115 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fc6cc222-decb-450a-8365-ccc0f93559da tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:21.681551 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fc6cc222-decb-450a-8365-ccc0f93559da tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:21.682246 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fc6cc222-decb-450a-8365-ccc0f93559da tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:21.682699 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fc6cc222-decb-450a-8365-ccc0f93559da tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:21.683124 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fc6cc222-decb-450a-8365-ccc0f93559da tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:21.689199 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:46:21.736641 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-3e58a549-2904-437f-bce4-8b9717abb875 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:21.737279 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-3e58a549-2904-437f-bce4-8b9717abb875 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:21.746134 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3e58a549-2904-437f-bce4-8b9717abb875 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:21.746620 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3e58a549-2904-437f-bce4-8b9717abb875 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:21.747047 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3e58a549-2904-437f-bce4-8b9717abb875 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:21.747988 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3e58a549-2904-437f-bce4-8b9717abb875 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:21.748437 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3e58a549-2904-437f-bce4-8b9717abb875 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:21.748875 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3e58a549-2904-437f-bce4-8b9717abb875 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:21.830081 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-fc6cc222-decb-450a-8365-ccc0f93559da tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:21.838106 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-fc6cc222-decb-450a-8365-ccc0f93559da tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1520 microversion: 2.1 time: 0.169284 Oct 18 11:46:21.838665 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 375/772] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:21 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:21.881941 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-3e58a549-2904-437f-bce4-8b9717abb875 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:21.889894 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-3e58a549-2904-437f-bce4-8b9717abb875 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:21.891337 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-3e58a549-2904-437f-bce4-8b9717abb875 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:21.892493 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-3e58a549-2904-437f-bce4-8b9717abb875 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1721 microversion: 2.20 time: 0.159794 Oct 18 11:46:21.893071 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 398/773] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:21 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:46:22.860659 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-18ec45a9-74d3-4965-85ea-9a8a3252cb1e tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:22.861293 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-18ec45a9-74d3-4965-85ea-9a8a3252cb1e tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:22.867903 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-18ec45a9-74d3-4965-85ea-9a8a3252cb1e tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:22.868388 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-18ec45a9-74d3-4965-85ea-9a8a3252cb1e tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:22.868785 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-18ec45a9-74d3-4965-85ea-9a8a3252cb1e tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:22.869507 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-18ec45a9-74d3-4965-85ea-9a8a3252cb1e tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:22.869953 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-18ec45a9-74d3-4965-85ea-9a8a3252cb1e tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:22.870368 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-18ec45a9-74d3-4965-85ea-9a8a3252cb1e tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:22.918018 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-a7deb4eb-c582-43b9-8def-f4642bce6d2d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:22.918616 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-a7deb4eb-c582-43b9-8def-f4642bce6d2d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:22.926527 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a7deb4eb-c582-43b9-8def-f4642bce6d2d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:22.927018 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a7deb4eb-c582-43b9-8def-f4642bce6d2d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:22.927572 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a7deb4eb-c582-43b9-8def-f4642bce6d2d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:22.928538 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a7deb4eb-c582-43b9-8def-f4642bce6d2d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:22.929017 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a7deb4eb-c582-43b9-8def-f4642bce6d2d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:22.929443 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a7deb4eb-c582-43b9-8def-f4642bce6d2d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:23.010152 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-18ec45a9-74d3-4965-85ea-9a8a3252cb1e tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:23.018490 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-18ec45a9-74d3-4965-85ea-9a8a3252cb1e tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1520 microversion: 2.1 time: 0.161664 Oct 18 11:46:23.019452 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 376/774] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:22 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:23.074302 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-a7deb4eb-c582-43b9-8def-f4642bce6d2d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:23.082779 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-a7deb4eb-c582-43b9-8def-f4642bce6d2d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:23.084940 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-a7deb4eb-c582-43b9-8def-f4642bce6d2d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:23.086107 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-a7deb4eb-c582-43b9-8def-f4642bce6d2d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1721 microversion: 2.20 time: 0.172050 Oct 18 11:46:23.086666 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 399/775] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:22 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:46:23.931435 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-feb47763-f0d0-42cb-898d-98b610191d63 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:23.933717 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-feb47763-f0d0-42cb-898d-98b610191d63 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:23.940141 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-feb47763-f0d0-42cb-898d-98b610191d63 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:23.940629 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-feb47763-f0d0-42cb-898d-98b610191d63 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:23.941126 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-feb47763-f0d0-42cb-898d-98b610191d63 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:23.941825 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-feb47763-f0d0-42cb-898d-98b610191d63 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:23.942294 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-feb47763-f0d0-42cb-898d-98b610191d63 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:23.943203 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-feb47763-f0d0-42cb-898d-98b610191d63 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:23.973841 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-feb47763-f0d0-42cb-898d-98b610191d63 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046307 Oct 18 11:46:23.974392 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 377/776] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Oct 18 11:46:23 2022] GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:46:24.042578 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-c4ad1e4e-42ed-43d2-af77-3f0f70d113b0 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:24.043190 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-c4ad1e4e-42ed-43d2-af77-3f0f70d113b0 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:24.049500 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c4ad1e4e-42ed-43d2-af77-3f0f70d113b0 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:24.049975 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c4ad1e4e-42ed-43d2-af77-3f0f70d113b0 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:24.050501 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c4ad1e4e-42ed-43d2-af77-3f0f70d113b0 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:24.051209 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c4ad1e4e-42ed-43d2-af77-3f0f70d113b0 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:24.051632 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c4ad1e4e-42ed-43d2-af77-3f0f70d113b0 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:24.052045 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c4ad1e4e-42ed-43d2-af77-3f0f70d113b0 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:24.114714 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-87afec99-5576-44e3-8220-f3f352300d91 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:24.115850 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-87afec99-5576-44e3-8220-f3f352300d91 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:24.123032 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-87afec99-5576-44e3-8220-f3f352300d91 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:24.123593 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-87afec99-5576-44e3-8220-f3f352300d91 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:24.124129 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-87afec99-5576-44e3-8220-f3f352300d91 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:24.125125 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-87afec99-5576-44e3-8220-f3f352300d91 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:24.125850 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-87afec99-5576-44e3-8220-f3f352300d91 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:24.126336 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-87afec99-5576-44e3-8220-f3f352300d91 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:24.195696 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-c4ad1e4e-42ed-43d2-af77-3f0f70d113b0 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:24.207967 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-c4ad1e4e-42ed-43d2-af77-3f0f70d113b0 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1576 microversion: 2.1 time: 0.165740 Oct 18 11:46:24.223460 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 400/777] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:24 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1576 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:24.230383 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-48fedeae-da53-49e4-a579-c4866d1144f8 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:24.230875 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-48fedeae-da53-49e4-a579-c4866d1144f8 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:24.237153 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-48fedeae-da53-49e4-a579-c4866d1144f8 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:24.237749 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-48fedeae-da53-49e4-a579-c4866d1144f8 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:24.238295 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-48fedeae-da53-49e4-a579-c4866d1144f8 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:24.239092 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-48fedeae-da53-49e4-a579-c4866d1144f8 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:24.240193 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-48fedeae-da53-49e4-a579-c4866d1144f8 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:24.240982 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-48fedeae-da53-49e4-a579-c4866d1144f8 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:24.279391 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-48fedeae-da53-49e4-a579-c4866d1144f8 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488/os-volume_attachments/c0d10947-081e-47e1-9945-e290f0de5d6e" status: 200 len: 194 microversion: 2.1 time: 0.056810 Oct 18 11:46:24.280008 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 401/778] 10.222.0.17 () {58 vars in 1413 bytes} [Tue Oct 18 11:46:24 2022] GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488/os-volume_attachments/c0d10947-081e-47e1-9945-e290f0de5d6e => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:46:24.292395 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-88ec2a59-176f-4679-9d03-831ae360e78d tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:24.292919 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-88ec2a59-176f-4679-9d03-831ae360e78d tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:24.298767 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-88ec2a59-176f-4679-9d03-831ae360e78d tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:24.299243 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-88ec2a59-176f-4679-9d03-831ae360e78d tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:24.299845 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-88ec2a59-176f-4679-9d03-831ae360e78d tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:24.300873 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-88ec2a59-176f-4679-9d03-831ae360e78d tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:24.301325 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-88ec2a59-176f-4679-9d03-831ae360e78d tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:24.302410 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-88ec2a59-176f-4679-9d03-831ae360e78d tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:24.340228 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-87afec99-5576-44e3-8220-f3f352300d91 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:24.355052 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-87afec99-5576-44e3-8220-f3f352300d91 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:24.356586 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-87afec99-5576-44e3-8220-f3f352300d91 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:24.358902 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-87afec99-5576-44e3-8220-f3f352300d91 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1721 microversion: 2.20 time: 0.249439 Oct 18 11:46:24.359520 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 378/779] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:24 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1721 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:46:24.389746 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.objects.instance [None req-88ec2a59-176f-4679-9d03-831ae360e78d tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lazy-loading 'services' on Instance uuid ad4d6e0a-d6d8-42b6-a448-621a32b1c488 {{(pid=125485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:46:24.477955 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-88ec2a59-176f-4679-9d03-831ae360e78d tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488/os-volume_attachments/c0d10947-081e-47e1-9945-e290f0de5d6e" status: 202 len: 0 microversion: 2.1 time: 0.190278 Oct 18 11:46:24.482341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 402/780] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Oct 18 11:46:24 2022] DELETE /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488/os-volume_attachments/c0d10947-081e-47e1-9945-e290f0de5d6e => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 11:46:25.235216 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-af0a3fa1-88a7-4246-9a6c-803c9b496ec8 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:25.235824 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-af0a3fa1-88a7-4246-9a6c-803c9b496ec8 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:25.242223 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-af0a3fa1-88a7-4246-9a6c-803c9b496ec8 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:25.242707 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-af0a3fa1-88a7-4246-9a6c-803c9b496ec8 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:25.243141 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-af0a3fa1-88a7-4246-9a6c-803c9b496ec8 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:25.243858 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-af0a3fa1-88a7-4246-9a6c-803c9b496ec8 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:25.244306 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-af0a3fa1-88a7-4246-9a6c-803c9b496ec8 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:25.244722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-af0a3fa1-88a7-4246-9a6c-803c9b496ec8 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:25.388069 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-6686874a-f535-4e96-8c4c-09d3489bde46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:25.388807 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-6686874a-f535-4e96-8c4c-09d3489bde46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:25.395136 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6686874a-f535-4e96-8c4c-09d3489bde46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:25.396236 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6686874a-f535-4e96-8c4c-09d3489bde46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:25.396664 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6686874a-f535-4e96-8c4c-09d3489bde46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:25.397376 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6686874a-f535-4e96-8c4c-09d3489bde46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:25.397814 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6686874a-f535-4e96-8c4c-09d3489bde46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:25.398223 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6686874a-f535-4e96-8c4c-09d3489bde46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:25.441097 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-af0a3fa1-88a7-4246-9a6c-803c9b496ec8 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:25.452763 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-af0a3fa1-88a7-4246-9a6c-803c9b496ec8 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1576 microversion: 2.1 time: 0.220903 Oct 18 11:46:25.460894 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 379/781] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:25 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1576 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:25.549440 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-6686874a-f535-4e96-8c4c-09d3489bde46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:25.559311 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-6686874a-f535-4e96-8c4c-09d3489bde46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:25.560950 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-6686874a-f535-4e96-8c4c-09d3489bde46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:25.562108 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-6686874a-f535-4e96-8c4c-09d3489bde46 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1721 microversion: 2.20 time: 0.178864 Oct 18 11:46:25.562654 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 403/782] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:25 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:46:25.607455 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-43654cad-1ce5-467e-b183-bb7b2c147f40 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:25.608079 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-43654cad-1ce5-467e-b183-bb7b2c147f40 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:25.614441 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-43654cad-1ce5-467e-b183-bb7b2c147f40 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:25.614931 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-43654cad-1ce5-467e-b183-bb7b2c147f40 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:25.615378 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-43654cad-1ce5-467e-b183-bb7b2c147f40 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:25.616041 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-43654cad-1ce5-467e-b183-bb7b2c147f40 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:25.616485 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-43654cad-1ce5-467e-b183-bb7b2c147f40 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:25.617093 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-43654cad-1ce5-467e-b183-bb7b2c147f40 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:25.650904 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-43654cad-1ce5-467e-b183-bb7b2c147f40 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488/os-volume_attachments/8647df0c-03b7-4c66-ab42-54a2915a384d" status: 200 len: 194 microversion: 2.1 time: 0.047528 Oct 18 11:46:25.651496 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 380/783] 10.222.0.17 () {58 vars in 1413 bytes} [Tue Oct 18 11:46:25 2022] GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488/os-volume_attachments/8647df0c-03b7-4c66-ab42-54a2915a384d => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:46:25.663251 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-78badcca-43e9-43cd-bb3b-450c8e3e58d1 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:25.663736 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-78badcca-43e9-43cd-bb3b-450c8e3e58d1 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:25.675714 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-78badcca-43e9-43cd-bb3b-450c8e3e58d1 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:25.676193 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-78badcca-43e9-43cd-bb3b-450c8e3e58d1 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:25.676614 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-78badcca-43e9-43cd-bb3b-450c8e3e58d1 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:25.677409 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-78badcca-43e9-43cd-bb3b-450c8e3e58d1 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:25.677851 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-78badcca-43e9-43cd-bb3b-450c8e3e58d1 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:25.678264 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-78badcca-43e9-43cd-bb3b-450c8e3e58d1 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:25.763252 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.objects.instance [None req-78badcca-43e9-43cd-bb3b-450c8e3e58d1 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lazy-loading 'services' on Instance uuid ad4d6e0a-d6d8-42b6-a448-621a32b1c488 {{(pid=125485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:46:25.766750 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:46:25.839060 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-78badcca-43e9-43cd-bb3b-450c8e3e58d1 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488/os-volume_attachments/8647df0c-03b7-4c66-ab42-54a2915a384d" status: 202 len: 0 microversion: 2.1 time: 0.179577 Oct 18 11:46:25.839636 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 404/784] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Oct 18 11:46:25 2022] DELETE /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488/os-volume_attachments/8647df0c-03b7-4c66-ab42-54a2915a384d => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 11:46:26.476932 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-d6d7ed30-65b2-41ce-9dd4-6d9e7deced61 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:26.477481 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-d6d7ed30-65b2-41ce-9dd4-6d9e7deced61 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:26.483880 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d6d7ed30-65b2-41ce-9dd4-6d9e7deced61 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:26.484359 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d6d7ed30-65b2-41ce-9dd4-6d9e7deced61 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:26.484792 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d6d7ed30-65b2-41ce-9dd4-6d9e7deced61 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:26.485497 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d6d7ed30-65b2-41ce-9dd4-6d9e7deced61 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:26.485949 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d6d7ed30-65b2-41ce-9dd4-6d9e7deced61 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:26.486369 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d6d7ed30-65b2-41ce-9dd4-6d9e7deced61 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:26.589773 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-5c390941-f86a-4463-9f2d-d1aac58bbae5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:26.590618 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-5c390941-f86a-4463-9f2d-d1aac58bbae5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:26.598426 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5c390941-f86a-4463-9f2d-d1aac58bbae5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:26.598941 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5c390941-f86a-4463-9f2d-d1aac58bbae5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:26.599377 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5c390941-f86a-4463-9f2d-d1aac58bbae5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:26.600070 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5c390941-f86a-4463-9f2d-d1aac58bbae5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:26.600538 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5c390941-f86a-4463-9f2d-d1aac58bbae5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:26.601160 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5c390941-f86a-4463-9f2d-d1aac58bbae5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:26.620825 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-d6d7ed30-65b2-41ce-9dd4-6d9e7deced61 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:26.629536 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-d6d7ed30-65b2-41ce-9dd4-6d9e7deced61 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1576 microversion: 2.1 time: 0.156374 Oct 18 11:46:26.630905 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 381/785] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:26 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:26.737888 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-5c390941-f86a-4463-9f2d-d1aac58bbae5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:26.747589 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-5c390941-f86a-4463-9f2d-d1aac58bbae5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:26.749058 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-5c390941-f86a-4463-9f2d-d1aac58bbae5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:26.750254 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-5c390941-f86a-4463-9f2d-d1aac58bbae5 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1721 microversion: 2.20 time: 0.165903 Oct 18 11:46:26.750819 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 405/786] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:26 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:46:27.034027 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-ff8fc8f0-68b2-404e-8944-7b37ddb3561a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:27.036322 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-ff8fc8f0-68b2-404e-8944-7b37ddb3561a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:27.042526 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ff8fc8f0-68b2-404e-8944-7b37ddb3561a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:27.042912 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ff8fc8f0-68b2-404e-8944-7b37ddb3561a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:27.043345 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ff8fc8f0-68b2-404e-8944-7b37ddb3561a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:27.044035 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ff8fc8f0-68b2-404e-8944-7b37ddb3561a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:27.044494 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ff8fc8f0-68b2-404e-8944-7b37ddb3561a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:27.044937 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ff8fc8f0-68b2-404e-8944-7b37ddb3561a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:27.074637 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-ff8fc8f0-68b2-404e-8944-7b37ddb3561a tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044621 Oct 18 11:46:27.075199 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 382/787] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Oct 18 11:46:27 2022] GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 11:46:27.197975 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ca1ebe4b-f0be-461a-89b9-d7c33bab35bc tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:27.209221 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-ca1ebe4b-f0be-461a-89b9-d7c33bab35bc tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:27.223256 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ca1ebe4b-f0be-461a-89b9-d7c33bab35bc tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:27.223786 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ca1ebe4b-f0be-461a-89b9-d7c33bab35bc tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:27.224341 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ca1ebe4b-f0be-461a-89b9-d7c33bab35bc tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:27.224940 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ca1ebe4b-f0be-461a-89b9-d7c33bab35bc tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:27.225663 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ca1ebe4b-f0be-461a-89b9-d7c33bab35bc tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:27.226090 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ca1ebe4b-f0be-461a-89b9-d7c33bab35bc tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:27.256962 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-ca1ebe4b-f0be-461a-89b9-d7c33bab35bc tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062979 Oct 18 11:46:27.257455 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 406/788] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Oct 18 11:46:27 2022] GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 11:46:27.323642 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-a6588305-49e7-426f-a4e0-c739fb9dc328 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:27.324173 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-a6588305-49e7-426f-a4e0-c739fb9dc328 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:27.330695 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a6588305-49e7-426f-a4e0-c739fb9dc328 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:27.331242 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a6588305-49e7-426f-a4e0-c739fb9dc328 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:27.331677 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a6588305-49e7-426f-a4e0-c739fb9dc328 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:27.332437 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a6588305-49e7-426f-a4e0-c739fb9dc328 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:27.333501 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a6588305-49e7-426f-a4e0-c739fb9dc328 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:27.334112 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a6588305-49e7-426f-a4e0-c739fb9dc328 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:27.379226 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-a6588305-49e7-426f-a4e0-c739fb9dc328 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Going to try to terminate instance {{(pid=125486) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 11:46:27.476312 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-a6588305-49e7-426f-a4e0-c739fb9dc328 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488" status: 204 len: 0 microversion: 2.1 time: 0.154975 Oct 18 11:46:27.477467 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 383/789] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Oct 18 11:46:27 2022] DELETE /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 11:46:27.485829 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-7c85f5bd-c6e0-4fcd-9d0e-5681904d7f8b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:27.486528 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-7c85f5bd-c6e0-4fcd-9d0e-5681904d7f8b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:27.492784 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7c85f5bd-c6e0-4fcd-9d0e-5681904d7f8b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:27.493383 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7c85f5bd-c6e0-4fcd-9d0e-5681904d7f8b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:27.493880 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7c85f5bd-c6e0-4fcd-9d0e-5681904d7f8b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:27.494667 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7c85f5bd-c6e0-4fcd-9d0e-5681904d7f8b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:27.495145 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7c85f5bd-c6e0-4fcd-9d0e-5681904d7f8b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:27.495767 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7c85f5bd-c6e0-4fcd-9d0e-5681904d7f8b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:27.627901 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-7c85f5bd-c6e0-4fcd-9d0e-5681904d7f8b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:27.636264 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-7c85f5bd-c6e0-4fcd-9d0e-5681904d7f8b tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488" status: 200 len: 1673 microversion: 2.1 time: 0.154212 Oct 18 11:46:27.636859 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 407/790] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:27 2022] GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:46:27.655270 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-87217644-9dac-4986-b2d8-f896f4d4e434 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:27.656254 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-87217644-9dac-4986-b2d8-f896f4d4e434 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:27.663492 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-87217644-9dac-4986-b2d8-f896f4d4e434 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:27.664063 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-87217644-9dac-4986-b2d8-f896f4d4e434 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:27.664562 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-87217644-9dac-4986-b2d8-f896f4d4e434 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:27.665354 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-87217644-9dac-4986-b2d8-f896f4d4e434 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:27.665887 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-87217644-9dac-4986-b2d8-f896f4d4e434 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:27.666334 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-87217644-9dac-4986-b2d8-f896f4d4e434 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:27.776277 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-3439dd08-22db-4a53-b86e-7e9d8e8ade32 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:27.777297 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-3439dd08-22db-4a53-b86e-7e9d8e8ade32 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:27.784202 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3439dd08-22db-4a53-b86e-7e9d8e8ade32 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:27.785148 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3439dd08-22db-4a53-b86e-7e9d8e8ade32 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:27.785852 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3439dd08-22db-4a53-b86e-7e9d8e8ade32 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:27.787258 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3439dd08-22db-4a53-b86e-7e9d8e8ade32 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:27.787932 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3439dd08-22db-4a53-b86e-7e9d8e8ade32 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:27.788618 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3439dd08-22db-4a53-b86e-7e9d8e8ade32 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:27.814932 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-87217644-9dac-4986-b2d8-f896f4d4e434 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:27.839045 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-87217644-9dac-4986-b2d8-f896f4d4e434 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1576 microversion: 2.1 time: 0.188512 Oct 18 11:46:27.854234 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 384/791] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:27 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1576 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:27.988901 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-3439dd08-22db-4a53-b86e-7e9d8e8ade32 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:27.997943 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-3439dd08-22db-4a53-b86e-7e9d8e8ade32 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:27.999494 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-3439dd08-22db-4a53-b86e-7e9d8e8ade32 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:28.000814 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-3439dd08-22db-4a53-b86e-7e9d8e8ade32 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1742 microversion: 2.20 time: 0.228813 Oct 18 11:46:28.001649 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 408/792] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:27 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1742 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:46:28.660311 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-4216353e-d17d-4591-8539-99ca67c77943 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:28.660990 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-4216353e-d17d-4591-8539-99ca67c77943 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:28.667794 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4216353e-d17d-4591-8539-99ca67c77943 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:28.668274 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4216353e-d17d-4591-8539-99ca67c77943 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:28.668700 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4216353e-d17d-4591-8539-99ca67c77943 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:28.669406 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4216353e-d17d-4591-8539-99ca67c77943 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:28.669854 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4216353e-d17d-4591-8539-99ca67c77943 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:28.670270 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4216353e-d17d-4591-8539-99ca67c77943 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:28.807646 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-4216353e-d17d-4591-8539-99ca67c77943 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:28.816123 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-4216353e-d17d-4591-8539-99ca67c77943 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488" status: 200 len: 1673 microversion: 2.1 time: 0.159587 Oct 18 11:46:28.826258 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 385/793] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:28 2022] GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:28.864811 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-5bcd3753-22de-41e4-b7f8-bab498e2174f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:28.865453 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-5bcd3753-22de-41e4-b7f8-bab498e2174f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:28.871818 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5bcd3753-22de-41e4-b7f8-bab498e2174f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:28.872303 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5bcd3753-22de-41e4-b7f8-bab498e2174f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:28.872735 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5bcd3753-22de-41e4-b7f8-bab498e2174f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:28.873468 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5bcd3753-22de-41e4-b7f8-bab498e2174f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:28.873921 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5bcd3753-22de-41e4-b7f8-bab498e2174f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:28.874338 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5bcd3753-22de-41e4-b7f8-bab498e2174f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:29.014769 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-5bcd3753-22de-41e4-b7f8-bab498e2174f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:29.023410 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-5bcd3753-22de-41e4-b7f8-bab498e2174f tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1576 microversion: 2.1 time: 0.162992 Oct 18 11:46:29.023976 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 409/794] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:28 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:29.027651 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-6c1739f8-74be-4795-9adc-2fe5b4bf6702 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:29.028646 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-6c1739f8-74be-4795-9adc-2fe5b4bf6702 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:29.035451 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6c1739f8-74be-4795-9adc-2fe5b4bf6702 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:29.035945 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6c1739f8-74be-4795-9adc-2fe5b4bf6702 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:29.036370 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6c1739f8-74be-4795-9adc-2fe5b4bf6702 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:29.037109 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6c1739f8-74be-4795-9adc-2fe5b4bf6702 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:29.037562 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6c1739f8-74be-4795-9adc-2fe5b4bf6702 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:29.037982 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6c1739f8-74be-4795-9adc-2fe5b4bf6702 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:29.169240 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-6c1739f8-74be-4795-9adc-2fe5b4bf6702 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:29.179877 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-6c1739f8-74be-4795-9adc-2fe5b4bf6702 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:29.181686 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-6c1739f8-74be-4795-9adc-2fe5b4bf6702 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:29.182997 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-6c1739f8-74be-4795-9adc-2fe5b4bf6702 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1742 microversion: 2.20 time: 0.159904 Oct 18 11:46:29.183803 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 386/795] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:29 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:46:29.849507 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-89536363-404e-4f30-9a4f-842cae3bcd84 req-bc13ced2-112b-4b98-8cde-473f24362899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb2ccf2c-f9af-4953-90e6-88ab81961afe", "name": "network-vif-plugged", "status": "completed", "tag": "f0fce60c-3686-40ed-8866-f0bdb6333f0a"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:46:29.853684 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-aef973f3-000b-433b-8e78-8e04e9c867eb tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:29.854670 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-aef973f3-000b-433b-8e78-8e04e9c867eb tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:29.860541 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-89536363-404e-4f30-9a4f-842cae3bcd84 req-bc13ced2-112b-4b98-8cde-473f24362899 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:29.861290 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-89536363-404e-4f30-9a4f-842cae3bcd84 req-bc13ced2-112b-4b98-8cde-473f24362899 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:29.862425 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-89536363-404e-4f30-9a4f-842cae3bcd84 req-bc13ced2-112b-4b98-8cde-473f24362899 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:29.866737 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-aef973f3-000b-433b-8e78-8e04e9c867eb tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:29.867450 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-aef973f3-000b-433b-8e78-8e04e9c867eb tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:29.868030 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-aef973f3-000b-433b-8e78-8e04e9c867eb tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:29.868815 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-aef973f3-000b-433b-8e78-8e04e9c867eb tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:29.869502 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-aef973f3-000b-433b-8e78-8e04e9c867eb tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:29.870853 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-aef973f3-000b-433b-8e78-8e04e9c867eb tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:29.889649 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-89536363-404e-4f30-9a4f-842cae3bcd84 req-bc13ced2-112b-4b98-8cde-473f24362899 service nova] Creating event network-vif-plugged:f0fce60c-3686-40ed-8866-f0bdb6333f0a for instance bb2ccf2c-f9af-4953-90e6-88ab81961afe on hv-cinder-81558 Oct 18 11:46:29.900459 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-89536363-404e-4f30-9a4f-842cae3bcd84 req-bc13ced2-112b-4b98-8cde-473f24362899 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059777 Oct 18 11:46:29.902879 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 387/796] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:46:30.047791 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-2d5c3dfd-0f8c-4730-9411-309ed8c37326 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:30.048603 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-2d5c3dfd-0f8c-4730-9411-309ed8c37326 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:30.063310 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2d5c3dfd-0f8c-4730-9411-309ed8c37326 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:30.064073 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2d5c3dfd-0f8c-4730-9411-309ed8c37326 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:30.064914 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2d5c3dfd-0f8c-4730-9411-309ed8c37326 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:30.065886 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2d5c3dfd-0f8c-4730-9411-309ed8c37326 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:30.066526 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2d5c3dfd-0f8c-4730-9411-309ed8c37326 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:30.067691 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2d5c3dfd-0f8c-4730-9411-309ed8c37326 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:30.131605 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-aef973f3-000b-433b-8e78-8e04e9c867eb tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:30.143280 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-aef973f3-000b-433b-8e78-8e04e9c867eb tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488" status: 200 len: 1673 microversion: 2.1 time: 0.302143 Oct 18 11:46:30.154897 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 410/797] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:29 2022] GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488 => generated 1673 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:30.226877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-8a7f7da7-df39-4096-8537-74811e960ba7 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:30.228100 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-8a7f7da7-df39-4096-8537-74811e960ba7 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:30.235789 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8a7f7da7-df39-4096-8537-74811e960ba7 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:30.236514 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8a7f7da7-df39-4096-8537-74811e960ba7 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:30.237201 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8a7f7da7-df39-4096-8537-74811e960ba7 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:30.238083 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8a7f7da7-df39-4096-8537-74811e960ba7 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:30.239561 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8a7f7da7-df39-4096-8537-74811e960ba7 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:30.240161 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8a7f7da7-df39-4096-8537-74811e960ba7 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:30.422439 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-8a7f7da7-df39-4096-8537-74811e960ba7 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:30.432960 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-8a7f7da7-df39-4096-8537-74811e960ba7 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:30.434773 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-8a7f7da7-df39-4096-8537-74811e960ba7 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:30.436669 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-8a7f7da7-df39-4096-8537-74811e960ba7 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1737 microversion: 2.20 time: 0.230067 Oct 18 11:46:30.437650 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 411/798] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:30 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1737 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:46:30.637270 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-2d5c3dfd-0f8c-4730-9411-309ed8c37326 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:30.653961 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-2d5c3dfd-0f8c-4730-9411-309ed8c37326 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1576 microversion: 2.1 time: 0.610906 Oct 18 11:46:30.654537 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 388/799] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:30 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1576 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:31.174982 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-8c1184e5-fd6a-41ea-869e-5f36ab917ada tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:31.176335 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-8c1184e5-fd6a-41ea-869e-5f36ab917ada tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:31.187625 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8c1184e5-fd6a-41ea-869e-5f36ab917ada tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:31.188527 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8c1184e5-fd6a-41ea-869e-5f36ab917ada tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:31.189309 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8c1184e5-fd6a-41ea-869e-5f36ab917ada tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:31.191866 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8c1184e5-fd6a-41ea-869e-5f36ab917ada tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:31.194434 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8c1184e5-fd6a-41ea-869e-5f36ab917ada tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:31.194966 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8c1184e5-fd6a-41ea-869e-5f36ab917ada tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:31.294680 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-8c1184e5-fd6a-41ea-869e-5f36ab917ada tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:31.307447 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-8c1184e5-fd6a-41ea-869e-5f36ab917ada tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488" status: 200 len: 1606 microversion: 2.1 time: 0.139929 Oct 18 11:46:31.308357 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 412/800] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:31 2022] GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488 => generated 1606 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:46:31.464522 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-9039f38e-19be-4aef-91df-bbb8994f2a85 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:31.465637 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-9039f38e-19be-4aef-91df-bbb8994f2a85 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:31.485918 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9039f38e-19be-4aef-91df-bbb8994f2a85 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:31.487673 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9039f38e-19be-4aef-91df-bbb8994f2a85 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:31.491278 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9039f38e-19be-4aef-91df-bbb8994f2a85 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:31.494546 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9039f38e-19be-4aef-91df-bbb8994f2a85 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:31.498375 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9039f38e-19be-4aef-91df-bbb8994f2a85 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:31.499106 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9039f38e-19be-4aef-91df-bbb8994f2a85 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:31.720488 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-c69c91b2-5c50-4226-82f1-085a22a8babd req-0a8e3c25-e9c4-40ca-b51c-e0ad6bbd0e8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad4d6e0a-d6d8-42b6-a448-621a32b1c488", "name": "network-vif-deleted", "tag": "c37ea581-1038-42d3-af45-0da5fa44ccbd"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:46:31.745591 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-c69c91b2-5c50-4226-82f1-085a22a8babd req-0a8e3c25-e9c4-40ca-b51c-e0ad6bbd0e8d service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:31.746097 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-c69c91b2-5c50-4226-82f1-085a22a8babd req-0a8e3c25-e9c4-40ca-b51c-e0ad6bbd0e8d service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:31.746503 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-c69c91b2-5c50-4226-82f1-085a22a8babd req-0a8e3c25-e9c4-40ca-b51c-e0ad6bbd0e8d service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:31.781722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-c69c91b2-5c50-4226-82f1-085a22a8babd req-0a8e3c25-e9c4-40ca-b51c-e0ad6bbd0e8d service nova] Creating event network-vif-deleted:c37ea581-1038-42d3-af45-0da5fa44ccbd for instance ad4d6e0a-d6d8-42b6-a448-621a32b1c488 on hv-cinder-81558 Oct 18 11:46:31.790532 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-c69c91b2-5c50-4226-82f1-085a22a8babd req-0a8e3c25-e9c4-40ca-b51c-e0ad6bbd0e8d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.379272 Oct 18 11:46:31.791185 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 389/801] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:46:31.802886 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-9413bd05-4623-455b-a3e9-2f10008d18d4 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:31.806034 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-9413bd05-4623-455b-a3e9-2f10008d18d4 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:31.821078 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9413bd05-4623-455b-a3e9-2f10008d18d4 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:31.821810 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9413bd05-4623-455b-a3e9-2f10008d18d4 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:31.825769 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9413bd05-4623-455b-a3e9-2f10008d18d4 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:31.826727 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9413bd05-4623-455b-a3e9-2f10008d18d4 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:31.827434 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9413bd05-4623-455b-a3e9-2f10008d18d4 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:31.828274 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9413bd05-4623-455b-a3e9-2f10008d18d4 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:31.861476 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-9039f38e-19be-4aef-91df-bbb8994f2a85 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:31.873125 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-9039f38e-19be-4aef-91df-bbb8994f2a85 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:31.879928 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-9039f38e-19be-4aef-91df-bbb8994f2a85 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:31.881719 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-9039f38e-19be-4aef-91df-bbb8994f2a85 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1737 microversion: 2.20 time: 0.422108 Oct 18 11:46:31.882986 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 413/802] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:31 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1737 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:46:32.021880 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-9413bd05-4623-455b-a3e9-2f10008d18d4 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:32.032766 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-9413bd05-4623-455b-a3e9-2f10008d18d4 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1576 microversion: 2.1 time: 0.238365 Oct 18 11:46:32.044983 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 390/803] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:31 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1576 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:32.340108 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-00db0567-e65a-455e-b3fc-79ce5b3a0414 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:32.344790 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-00db0567-e65a-455e-b3fc-79ce5b3a0414 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:32.364702 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-00db0567-e65a-455e-b3fc-79ce5b3a0414 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:32.366633 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-00db0567-e65a-455e-b3fc-79ce5b3a0414 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:32.367262 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-00db0567-e65a-455e-b3fc-79ce5b3a0414 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:32.371207 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-00db0567-e65a-455e-b3fc-79ce5b3a0414 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:32.372434 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-00db0567-e65a-455e-b3fc-79ce5b3a0414 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:32.377507 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-00db0567-e65a-455e-b3fc-79ce5b3a0414 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:32.451526 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-00db0567-e65a-455e-b3fc-79ce5b3a0414 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:32.452423 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-00db0567-e65a-455e-b3fc-79ce5b3a0414 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:32.453346 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-00db0567-e65a-455e-b3fc-79ce5b3a0414 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:32.454076 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.objects.instance [None req-00db0567-e65a-455e-b3fc-79ce5b3a0414 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lazy-loading 'fault' on Instance uuid ad4d6e0a-d6d8-42b6-a448-621a32b1c488 {{(pid=125485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:46:32.515849 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-00db0567-e65a-455e-b3fc-79ce5b3a0414 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddd3d2bb8f647f2ba616141eb16622e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc96760658d4e19af26d6cf22e94172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:32.526491 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-00db0567-e65a-455e-b3fc-79ce5b3a0414 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488" status: 200 len: 1327 microversion: 2.1 time: 0.194541 Oct 18 11:46:32.527770 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 414/804] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:32 2022] GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488 => generated 1327 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:32.910004 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-dec1ede7-fa77-4326-81a0-4daec27fbe8d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:32.910614 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-dec1ede7-fa77-4326-81a0-4daec27fbe8d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:32.918365 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dec1ede7-fa77-4326-81a0-4daec27fbe8d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:32.919099 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dec1ede7-fa77-4326-81a0-4daec27fbe8d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:32.919884 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dec1ede7-fa77-4326-81a0-4daec27fbe8d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:32.921252 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dec1ede7-fa77-4326-81a0-4daec27fbe8d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:32.921838 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dec1ede7-fa77-4326-81a0-4daec27fbe8d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:32.922524 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-dec1ede7-fa77-4326-81a0-4daec27fbe8d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:32.946627 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:46:33.063639 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-84c43473-1896-4e57-9f63-f6febb2bb364 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:33.064085 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-84c43473-1896-4e57-9f63-f6febb2bb364 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:33.076184 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-84c43473-1896-4e57-9f63-f6febb2bb364 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:33.077095 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-84c43473-1896-4e57-9f63-f6febb2bb364 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:33.081275 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-84c43473-1896-4e57-9f63-f6febb2bb364 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:33.082302 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-84c43473-1896-4e57-9f63-f6febb2bb364 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:33.084398 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-84c43473-1896-4e57-9f63-f6febb2bb364 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:33.085132 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-84c43473-1896-4e57-9f63-f6febb2bb364 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:33.116487 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-dec1ede7-fa77-4326-81a0-4daec27fbe8d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:33.174100 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-dec1ede7-fa77-4326-81a0-4daec27fbe8d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:33.176170 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-dec1ede7-fa77-4326-81a0-4daec27fbe8d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:33.181660 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-dec1ede7-fa77-4326-81a0-4daec27fbe8d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1737 microversion: 2.20 time: 0.276541 Oct 18 11:46:33.183562 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 391/805] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:32 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1737 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:46:33.309219 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-84c43473-1896-4e57-9f63-f6febb2bb364 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:33.320227 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-84c43473-1896-4e57-9f63-f6febb2bb364 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1576 microversion: 2.1 time: 0.261185 Oct 18 11:46:33.321867 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 415/806] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:33 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1576 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:33.550343 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-b2cba41f-76bf-4f4d-80b8-89cdaae4e778 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:33.550963 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-b2cba41f-76bf-4f4d-80b8-89cdaae4e778 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:33.557163 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b2cba41f-76bf-4f4d-80b8-89cdaae4e778 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:33.557643 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b2cba41f-76bf-4f4d-80b8-89cdaae4e778 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:33.566560 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b2cba41f-76bf-4f4d-80b8-89cdaae4e778 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:33.570308 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b2cba41f-76bf-4f4d-80b8-89cdaae4e778 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:33.573424 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b2cba41f-76bf-4f4d-80b8-89cdaae4e778 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:33.576399 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b2cba41f-76bf-4f4d-80b8-89cdaae4e778 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:33.615635 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.wsgi [None req-b2cba41f-76bf-4f4d-80b8-89cdaae4e778 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] HTTP exception thrown: Instance ad4d6e0a-d6d8-42b6-a448-621a32b1c488 could not be found. Oct 18 11:46:33.618722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-b2cba41f-76bf-4f4d-80b8-89cdaae4e778 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Request method failure captured: Oct 18 11:46:33.618722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: request: GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488 HTTP/1.1 Oct 18 11:46:33.618722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept: application/json Oct 18 11:46:33.618722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept-Encoding: identity Oct 18 11:46:33.618722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Connection: close Oct 18 11:46:33.618722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Length: 0 Oct 18 11:46:33.618722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Type: application/json Oct 18 11:46:33.618722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Host: 10.222.0.17 Oct 18 11:46:33.618722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Openstack-System-Scope: None Oct 18 11:46:33.618722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: User-Agent: python-urllib3/1.26.12 Oct 18 11:46:33.618722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Auth-Token: gAAAAABjTpCrIy4GzQCjUy1CRhpWWp69iHHeGG1rwC3C0zuL3UPG3bIyKSCl6QRRPIuq8bZKkzY01EOqQmpc6SwgfWY80EaHeb7Ws4uWGbs24InFMZsFWR6Z_kxuVXDWHOl5BL3N-FmXhI9g4oBLtomfNoIxMN_DNXOgm2KUAyIALP9GvKTS8Co Oct 18 11:46:33.618722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Id: None Oct 18 11:46:33.618722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Name: None Oct 18 11:46:33.618722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Identity-Status: Confirmed Oct 18 11:46:33.618722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Is-Admin-Project: True Oct 18 11:46:33.618722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Id: default Oct 18 11:46:33.618722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Name: Default Oct 18 11:46:33.618722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Id: ffc96760658d4e19af26d6cf22e94172 Oct 18 11:46:33.618722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Name: tempest-AttachVolumeTestJSON-1223120040 Oct 18 11:46:33.618722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Role: reader,member Oct 18 11:46:33.618722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Roles: reader,member Oct 18 11:46:33.620246 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ffc96760658d4e19af26d6cf22e94172"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ffc96760658d4e19af26d6cf22e94172"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ffc96760658d4e19af26d6cf22e94172"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ffc96760658d4e19af26d6cf22e94172"}]}] Oct 18 11:46:33.620246 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant: tempest-AttachVolumeTestJSON-1223120040 Oct 18 11:46:33.620246 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Id: ffc96760658d4e19af26d6cf22e94172 Oct 18 11:46:33.620246 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1223120040 Oct 18 11:46:33.620246 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User: tempest-AttachVolumeTestJSON-1223120040-project Oct 18 11:46:33.620246 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Id: default Oct 18 11:46:33.620246 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Name: Default Oct 18 11:46:33.620246 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Id: bddd3d2bb8f647f2ba616141eb16622e Oct 18 11:46:33.620246 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Name: tempest-AttachVolumeTestJSON-1223120040-project Oct 18 11:46:33.620246 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: method: > Oct 18 11:46:33.620246 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: exception: Instance ad4d6e0a-d6d8-42b6-a448-621a32b1c488 could not be found. Oct 18 11:46:33.620246 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: action_args: {'id': 'ad4d6e0a-d6d8-42b6-a448-621a32b1c488'} Oct 18 11:46:33.621238 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:46:33.621238 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:46:33.621238 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:46:33.621238 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:46:33.621238 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:46:33.621238 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:46:33.621238 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:46:33.621238 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:46:33.621238 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:46:33.621238 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:46:33.621238 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad4d6e0a-d6d8-42b6-a448-621a32b1c488 could not be found. Oct 18 11:46:33.621238 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:46:33.621238 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:46:33.621238 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:46:33.621238 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:46:33.621238 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:46:33.621238 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:46:33.621238 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:46:33.621238 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:46:33.621238 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:46:33.622526 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:46:33.622526 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 11:46:33.622526 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 11:46:33.622526 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:46:33.622526 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:46:33.622526 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:46:33.622526 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:46:33.622526 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad4d6e0a-d6d8-42b6-a448-621a32b1c488 could not be found. Oct 18 11:46:33.622526 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:46:33.622526 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:46:33.622526 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:46:33.622526 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:46:33.622526 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:46:33.622526 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:46:33.622526 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:46:33.622526 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:46:33.622526 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad4d6e0a-d6d8-42b6-a448-621a32b1c488 could not be found. Oct 18 11:46:33.622526 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:46:33.624719 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-b2cba41f-76bf-4f4d-80b8-89cdaae4e778 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Returning 404 to user: Instance ad4d6e0a-d6d8-42b6-a448-621a32b1c488 could not be found. {{(pid=125486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:46:33.625773 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-b2cba41f-76bf-4f4d-80b8-89cdaae4e778 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488" status: 404 len: 111 microversion: 2.1 time: 0.079746 Oct 18 11:46:33.626934 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 392/807] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:33 2022] GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:46:33.637199 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-477cda4f-9f13-4202-8fec-2255fe144275 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '.version_select at 0x7f4bdbea2af0>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:33.666483 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:46:33.690880 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-477cda4f-9f13-4202-8fec-2255fe144275 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1295372192" status: 202 len: 0 microversion: 2.1 time: 0.059116 Oct 18 11:46:33.693181 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 416/808] 10.222.0.17 () {58 vars in 1221 bytes} [Tue Oct 18 11:46:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1295372192 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 11:46:34.170627 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-b0a7348c-dc0e-444e-a4fa-c1c85fb5dc38 req-87692826-f2ae-44f3-85e0-933ae6b7c90b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29b0847b-6a68-4b35-91d4-1ce725985f01", "name": "network-vif-plugged", "status": "completed", "tag": "ffd48d58-8fbc-42a2-a002-1687b4c71e8e"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:46:34.214486 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-aec8d470-3bb8-48bd-921d-87cc0eb2febc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:34.215413 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-aec8d470-3bb8-48bd-921d-87cc0eb2febc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:34.231743 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-aec8d470-3bb8-48bd-921d-87cc0eb2febc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:34.233650 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-aec8d470-3bb8-48bd-921d-87cc0eb2febc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:34.242872 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-aec8d470-3bb8-48bd-921d-87cc0eb2febc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:34.244787 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-b0a7348c-dc0e-444e-a4fa-c1c85fb5dc38 req-87692826-f2ae-44f3-85e0-933ae6b7c90b service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:34.248152 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-aec8d470-3bb8-48bd-921d-87cc0eb2febc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:34.248881 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-aec8d470-3bb8-48bd-921d-87cc0eb2febc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:34.249904 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-b0a7348c-dc0e-444e-a4fa-c1c85fb5dc38 req-87692826-f2ae-44f3-85e0-933ae6b7c90b service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:34.250593 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-b0a7348c-dc0e-444e-a4fa-c1c85fb5dc38 req-87692826-f2ae-44f3-85e0-933ae6b7c90b service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:34.253855 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-aec8d470-3bb8-48bd-921d-87cc0eb2febc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:34.292661 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-b0a7348c-dc0e-444e-a4fa-c1c85fb5dc38 req-87692826-f2ae-44f3-85e0-933ae6b7c90b service nova] Creating event network-vif-plugged:ffd48d58-8fbc-42a2-a002-1687b4c71e8e for instance 29b0847b-6a68-4b35-91d4-1ce725985f01 on hv-cinder-81558 Oct 18 11:46:34.302918 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-b0a7348c-dc0e-444e-a4fa-c1c85fb5dc38 req-87692826-f2ae-44f3-85e0-933ae6b7c90b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143440 Oct 18 11:46:34.304120 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 393/809] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:46:34.347910 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-2fd03e8c-6920-44d2-9920-6d2970ec9e21 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:34.349981 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-2fd03e8c-6920-44d2-9920-6d2970ec9e21 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:34.368357 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2fd03e8c-6920-44d2-9920-6d2970ec9e21 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:34.373718 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2fd03e8c-6920-44d2-9920-6d2970ec9e21 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:34.374719 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2fd03e8c-6920-44d2-9920-6d2970ec9e21 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:34.376138 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2fd03e8c-6920-44d2-9920-6d2970ec9e21 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:34.378373 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2fd03e8c-6920-44d2-9920-6d2970ec9e21 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:34.379013 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2fd03e8c-6920-44d2-9920-6d2970ec9e21 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:34.628319 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-aec8d470-3bb8-48bd-921d-87cc0eb2febc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:34.639638 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-aec8d470-3bb8-48bd-921d-87cc0eb2febc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:34.641843 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-aec8d470-3bb8-48bd-921d-87cc0eb2febc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:34.643785 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-aec8d470-3bb8-48bd-921d-87cc0eb2febc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1737 microversion: 2.20 time: 0.434171 Oct 18 11:46:34.662286 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 417/810] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:34 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1737 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:46:34.789296 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-2fd03e8c-6920-44d2-9920-6d2970ec9e21 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:34.808316 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-2fd03e8c-6920-44d2-9920-6d2970ec9e21 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1576 microversion: 2.1 time: 0.464345 Oct 18 11:46:34.821593 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 394/811] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:34 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1576 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:46:35.672205 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-7dbe4471-d272-4bfd-881e-8486f14c463b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:35.673011 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-7dbe4471-d272-4bfd-881e-8486f14c463b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:35.680175 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7dbe4471-d272-4bfd-881e-8486f14c463b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:35.680697 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7dbe4471-d272-4bfd-881e-8486f14c463b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:35.681126 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7dbe4471-d272-4bfd-881e-8486f14c463b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:35.682041 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7dbe4471-d272-4bfd-881e-8486f14c463b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:35.682650 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7dbe4471-d272-4bfd-881e-8486f14c463b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:35.683233 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7dbe4471-d272-4bfd-881e-8486f14c463b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:35.834603 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-ed175e1c-3282-4eb3-b4c8-63255108f439 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:35.836149 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-ed175e1c-3282-4eb3-b4c8-63255108f439 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:35.838204 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-7dbe4471-d272-4bfd-881e-8486f14c463b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:35.843317 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ed175e1c-3282-4eb3-b4c8-63255108f439 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:35.844008 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ed175e1c-3282-4eb3-b4c8-63255108f439 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:35.846498 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ed175e1c-3282-4eb3-b4c8-63255108f439 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:35.849722 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-7dbe4471-d272-4bfd-881e-8486f14c463b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:35.850789 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-7dbe4471-d272-4bfd-881e-8486f14c463b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:35.852140 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-7dbe4471-d272-4bfd-881e-8486f14c463b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1737 microversion: 2.20 time: 0.184311 Oct 18 11:46:35.852643 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ed175e1c-3282-4eb3-b4c8-63255108f439 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:35.853014 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 418/812] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:35 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1737 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:46:35.853566 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ed175e1c-3282-4eb3-b4c8-63255108f439 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:35.854293 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ed175e1c-3282-4eb3-b4c8-63255108f439 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:36.019452 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-ed175e1c-3282-4eb3-b4c8-63255108f439 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:36.028161 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-ed175e1c-3282-4eb3-b4c8-63255108f439 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1576 microversion: 2.1 time: 0.198487 Oct 18 11:46:36.028984 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 395/813] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:35 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1576 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:46:36.885118 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-fb66e1c6-af00-452c-875a-31725a357d37 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:36.889879 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-fb66e1c6-af00-452c-875a-31725a357d37 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:36.898798 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fb66e1c6-af00-452c-875a-31725a357d37 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:36.901083 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fb66e1c6-af00-452c-875a-31725a357d37 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:36.901742 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fb66e1c6-af00-452c-875a-31725a357d37 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:36.902661 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fb66e1c6-af00-452c-875a-31725a357d37 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:36.903114 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fb66e1c6-af00-452c-875a-31725a357d37 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:36.903541 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fb66e1c6-af00-452c-875a-31725a357d37 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:37.056145 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-7230f9c9-9072-4db4-876b-0e171190ae81 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:37.057873 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-7230f9c9-9072-4db4-876b-0e171190ae81 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:37.066484 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7230f9c9-9072-4db4-876b-0e171190ae81 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:37.067538 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7230f9c9-9072-4db4-876b-0e171190ae81 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:37.067981 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7230f9c9-9072-4db4-876b-0e171190ae81 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:37.068692 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7230f9c9-9072-4db4-876b-0e171190ae81 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:37.069177 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7230f9c9-9072-4db4-876b-0e171190ae81 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:37.069610 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7230f9c9-9072-4db4-876b-0e171190ae81 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:37.100590 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-fb66e1c6-af00-452c-875a-31725a357d37 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:37.118558 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-fb66e1c6-af00-452c-875a-31725a357d37 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:37.120020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-fb66e1c6-af00-452c-875a-31725a357d37 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:37.121222 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-fb66e1c6-af00-452c-875a-31725a357d37 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1737 microversion: 2.20 time: 0.246608 Oct 18 11:46:37.121892 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 419/814] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:36 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1737 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:46:37.263487 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-7230f9c9-9072-4db4-876b-0e171190ae81 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:37.272579 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-7230f9c9-9072-4db4-876b-0e171190ae81 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1563 microversion: 2.1 time: 0.222421 Oct 18 11:46:37.273224 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 396/815] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:37 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1563 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:37.594529 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-921c0ea8-72ef-4181-b418-2a7f598f9135 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:37.595264 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-921c0ea8-72ef-4181-b418-2a7f598f9135 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:37.602893 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-921c0ea8-72ef-4181-b418-2a7f598f9135 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:37.603684 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-921c0ea8-72ef-4181-b418-2a7f598f9135 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:37.604339 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-921c0ea8-72ef-4181-b418-2a7f598f9135 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:37.605295 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-921c0ea8-72ef-4181-b418-2a7f598f9135 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:37.605909 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-921c0ea8-72ef-4181-b418-2a7f598f9135 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:37.606504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-921c0ea8-72ef-4181-b418-2a7f598f9135 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:37.621331 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.wsgi [None req-921c0ea8-72ef-4181-b418-2a7f598f9135 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] HTTP exception thrown: Instance ad4d6e0a-d6d8-42b6-a448-621a32b1c488 could not be found. Oct 18 11:46:37.624393 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-921c0ea8-72ef-4181-b418-2a7f598f9135 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Request method failure captured: Oct 18 11:46:37.624393 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: DELETE /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488 HTTP/1.1 Oct 18 11:46:37.624393 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:46:37.624393 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:46:37.624393 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:46:37.624393 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 0 Oct 18 11:46:37.624393 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:46:37.624393 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:46:37.624393 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:46:37.624393 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:46:37.624393 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpCrIy4GzQCjUy1CRhpWWp69iHHeGG1rwC3C0zuL3UPG3bIyKSCl6QRRPIuq8bZKkzY01EOqQmpc6SwgfWY80EaHeb7Ws4uWGbs24InFMZsFWR6Z_kxuVXDWHOl5BL3N-FmXhI9g4oBLtomfNoIxMN_DNXOgm2KUAyIALP9GvKTS8Co Oct 18 11:46:37.624393 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:46:37.624393 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:46:37.624393 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:46:37.624393 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:46:37.624393 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:46:37.624393 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:46:37.624393 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: ffc96760658d4e19af26d6cf22e94172 Oct 18 11:46:37.624393 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-AttachVolumeTestJSON-1223120040 Oct 18 11:46:37.624393 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:46:37.624393 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:46:37.627174 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ffc96760658d4e19af26d6cf22e94172"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ffc96760658d4e19af26d6cf22e94172"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ffc96760658d4e19af26d6cf22e94172"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ffc96760658d4e19af26d6cf22e94172"}]}] Oct 18 11:46:37.627174 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-AttachVolumeTestJSON-1223120040 Oct 18 11:46:37.627174 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: ffc96760658d4e19af26d6cf22e94172 Oct 18 11:46:37.627174 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1223120040 Oct 18 11:46:37.627174 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-AttachVolumeTestJSON-1223120040-project Oct 18 11:46:37.627174 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:46:37.627174 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:46:37.627174 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: bddd3d2bb8f647f2ba616141eb16622e Oct 18 11:46:37.627174 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-AttachVolumeTestJSON-1223120040-project Oct 18 11:46:37.627174 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: > Oct 18 11:46:37.627174 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Instance ad4d6e0a-d6d8-42b6-a448-621a32b1c488 could not be found. Oct 18 11:46:37.627174 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'id': 'ad4d6e0a-d6d8-42b6-a448-621a32b1c488'} Oct 18 11:46:37.628744 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:46:37.628744 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:46:37.628744 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:46:37.628744 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:46:37.628744 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:46:37.628744 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:46:37.628744 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:46:37.628744 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:46:37.628744 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:46:37.628744 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:46:37.628744 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad4d6e0a-d6d8-42b6-a448-621a32b1c488 could not be found. Oct 18 11:46:37.628744 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:46:37.628744 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:46:37.628744 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:46:37.628744 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:46:37.628744 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:46:37.628744 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:46:37.628744 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:46:37.628744 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:46:37.628744 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:46:37.631841 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:46:37.631841 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 11:46:37.631841 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 11:46:37.631841 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 11:46:37.631841 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 11:46:37.631841 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:46:37.631841 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:46:37.631841 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:46:37.631841 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:46:37.631841 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad4d6e0a-d6d8-42b6-a448-621a32b1c488 could not be found. Oct 18 11:46:37.631841 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:46:37.631841 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:46:37.631841 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:46:37.631841 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:46:37.631841 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:46:37.631841 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:46:37.631841 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:46:37.631841 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:46:37.631841 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad4d6e0a-d6d8-42b6-a448-621a32b1c488 could not be found. Oct 18 11:46:37.631841 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:46:37.635668 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-921c0ea8-72ef-4181-b418-2a7f598f9135 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Returning 404 to user: Instance ad4d6e0a-d6d8-42b6-a448-621a32b1c488 could not be found. {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:46:37.637518 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-921c0ea8-72ef-4181-b418-2a7f598f9135 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488" status: 404 len: 111 microversion: 2.1 time: 0.047442 Oct 18 11:46:37.638798 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 420/816] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Oct 18 11:46:37 2022] DELETE /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:46:37.648635 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-1e7324a3-6690-428d-8db4-29874e82d1e4 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:37.649443 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-1e7324a3-6690-428d-8db4-29874e82d1e4 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: ad4d6e0a-d6d8-42b6-a448-621a32b1c488] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:37.657227 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1e7324a3-6690-428d-8db4-29874e82d1e4 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:37.657983 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1e7324a3-6690-428d-8db4-29874e82d1e4 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:37.658529 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1e7324a3-6690-428d-8db4-29874e82d1e4 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:37.659233 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1e7324a3-6690-428d-8db4-29874e82d1e4 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:37.659690 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1e7324a3-6690-428d-8db4-29874e82d1e4 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:37.660113 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-1e7324a3-6690-428d-8db4-29874e82d1e4 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:37.675650 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.wsgi [None req-1e7324a3-6690-428d-8db4-29874e82d1e4 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] HTTP exception thrown: Instance ad4d6e0a-d6d8-42b6-a448-621a32b1c488 could not be found. Oct 18 11:46:37.677814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-1e7324a3-6690-428d-8db4-29874e82d1e4 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Request method failure captured: Oct 18 11:46:37.677814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: request: GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488 HTTP/1.1 Oct 18 11:46:37.677814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept: application/json Oct 18 11:46:37.677814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept-Encoding: identity Oct 18 11:46:37.677814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Connection: close Oct 18 11:46:37.677814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Length: 0 Oct 18 11:46:37.677814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Type: application/json Oct 18 11:46:37.677814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Host: 10.222.0.17 Oct 18 11:46:37.677814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Openstack-System-Scope: None Oct 18 11:46:37.677814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: User-Agent: python-urllib3/1.26.12 Oct 18 11:46:37.677814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Auth-Token: gAAAAABjTpCrIy4GzQCjUy1CRhpWWp69iHHeGG1rwC3C0zuL3UPG3bIyKSCl6QRRPIuq8bZKkzY01EOqQmpc6SwgfWY80EaHeb7Ws4uWGbs24InFMZsFWR6Z_kxuVXDWHOl5BL3N-FmXhI9g4oBLtomfNoIxMN_DNXOgm2KUAyIALP9GvKTS8Co Oct 18 11:46:37.677814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Id: None Oct 18 11:46:37.677814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Name: None Oct 18 11:46:37.677814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Identity-Status: Confirmed Oct 18 11:46:37.677814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Is-Admin-Project: True Oct 18 11:46:37.677814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Id: default Oct 18 11:46:37.677814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Name: Default Oct 18 11:46:37.677814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Id: ffc96760658d4e19af26d6cf22e94172 Oct 18 11:46:37.677814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Name: tempest-AttachVolumeTestJSON-1223120040 Oct 18 11:46:37.677814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Role: reader,member Oct 18 11:46:37.677814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Roles: reader,member Oct 18 11:46:37.679399 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ffc96760658d4e19af26d6cf22e94172"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ffc96760658d4e19af26d6cf22e94172"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ffc96760658d4e19af26d6cf22e94172"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ffc96760658d4e19af26d6cf22e94172"}]}] Oct 18 11:46:37.679399 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant: tempest-AttachVolumeTestJSON-1223120040 Oct 18 11:46:37.679399 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Id: ffc96760658d4e19af26d6cf22e94172 Oct 18 11:46:37.679399 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1223120040 Oct 18 11:46:37.679399 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User: tempest-AttachVolumeTestJSON-1223120040-project Oct 18 11:46:37.679399 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Id: default Oct 18 11:46:37.679399 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Name: Default Oct 18 11:46:37.679399 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Id: bddd3d2bb8f647f2ba616141eb16622e Oct 18 11:46:37.679399 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Name: tempest-AttachVolumeTestJSON-1223120040-project Oct 18 11:46:37.679399 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: method: > Oct 18 11:46:37.679399 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: exception: Instance ad4d6e0a-d6d8-42b6-a448-621a32b1c488 could not be found. Oct 18 11:46:37.679399 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: action_args: {'id': 'ad4d6e0a-d6d8-42b6-a448-621a32b1c488'} Oct 18 11:46:37.680262 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:46:37.680262 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:46:37.680262 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:46:37.680262 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:46:37.680262 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:46:37.680262 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:46:37.680262 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:46:37.680262 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:46:37.680262 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:46:37.680262 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:46:37.680262 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad4d6e0a-d6d8-42b6-a448-621a32b1c488 could not be found. Oct 18 11:46:37.680262 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:46:37.680262 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:46:37.680262 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:46:37.680262 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:46:37.680262 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:46:37.680262 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:46:37.680262 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:46:37.680262 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:46:37.680262 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:46:37.681712 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:46:37.681712 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 11:46:37.681712 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 11:46:37.681712 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:46:37.681712 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:46:37.681712 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:46:37.681712 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:46:37.681712 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad4d6e0a-d6d8-42b6-a448-621a32b1c488 could not be found. Oct 18 11:46:37.681712 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:46:37.681712 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:46:37.681712 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:46:37.681712 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:46:37.681712 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:46:37.681712 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:46:37.681712 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:46:37.681712 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:46:37.681712 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad4d6e0a-d6d8-42b6-a448-621a32b1c488 could not be found. Oct 18 11:46:37.681712 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:46:37.683683 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-1e7324a3-6690-428d-8db4-29874e82d1e4 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Returning 404 to user: Instance ad4d6e0a-d6d8-42b6-a448-621a32b1c488 could not be found. {{(pid=125486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:46:37.684724 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-1e7324a3-6690-428d-8db4-29874e82d1e4 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488" status: 404 len: 111 microversion: 2.1 time: 0.041535 Oct 18 11:46:37.685336 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 397/817] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:37 2022] GET /compute/v2.1/servers/ad4d6e0a-d6d8-42b6-a448-621a32b1c488 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:46:38.157576 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ab69daee-7ca2-4be9-a934-7be15a468af3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:38.158404 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-ab69daee-7ca2-4be9-a934-7be15a468af3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:38.166924 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ab69daee-7ca2-4be9-a934-7be15a468af3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:38.167533 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ab69daee-7ca2-4be9-a934-7be15a468af3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:38.168061 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ab69daee-7ca2-4be9-a934-7be15a468af3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:38.168828 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ab69daee-7ca2-4be9-a934-7be15a468af3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:38.169547 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ab69daee-7ca2-4be9-a934-7be15a468af3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:38.170129 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ab69daee-7ca2-4be9-a934-7be15a468af3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:38.343250 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-ab69daee-7ca2-4be9-a934-7be15a468af3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:38.354395 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-ab69daee-7ca2-4be9-a934-7be15a468af3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:38.356569 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-ab69daee-7ca2-4be9-a934-7be15a468af3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:38.358290 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-ab69daee-7ca2-4be9-a934-7be15a468af3 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1737 microversion: 2.20 time: 0.214399 Oct 18 11:46:38.359203 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 421/818] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:38 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:46:38.844808 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-2b1f912a-5a45-4192-9e83-70077be6c3cd tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:38.845313 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-2b1f912a-5a45-4192-9e83-70077be6c3cd tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:38.852730 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2b1f912a-5a45-4192-9e83-70077be6c3cd tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:38.853263 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2b1f912a-5a45-4192-9e83-70077be6c3cd tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:38.853702 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2b1f912a-5a45-4192-9e83-70077be6c3cd tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:38.854393 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2b1f912a-5a45-4192-9e83-70077be6c3cd tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:38.855074 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2b1f912a-5a45-4192-9e83-70077be6c3cd tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:38.855711 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2b1f912a-5a45-4192-9e83-70077be6c3cd tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:38.871146 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.wsgi [None req-2b1f912a-5a45-4192-9e83-70077be6c3cd tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] HTTP exception thrown: Instance 96c06c00-7190-4ae9-a194-2d8f6123a781 could not be found. Oct 18 11:46:38.872466 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-2b1f912a-5a45-4192-9e83-70077be6c3cd tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Request method failure captured: Oct 18 11:46:38.872466 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: request: DELETE /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 HTTP/1.1 Oct 18 11:46:38.872466 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept: application/json Oct 18 11:46:38.872466 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept-Encoding: identity Oct 18 11:46:38.872466 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Connection: close Oct 18 11:46:38.872466 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Length: 0 Oct 18 11:46:38.872466 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Type: application/json Oct 18 11:46:38.872466 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Host: 10.222.0.17 Oct 18 11:46:38.872466 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Openstack-System-Scope: None Oct 18 11:46:38.872466 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: User-Agent: python-urllib3/1.26.12 Oct 18 11:46:38.872466 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Auth-Token: gAAAAABjTpCrIy4GzQCjUy1CRhpWWp69iHHeGG1rwC3C0zuL3UPG3bIyKSCl6QRRPIuq8bZKkzY01EOqQmpc6SwgfWY80EaHeb7Ws4uWGbs24InFMZsFWR6Z_kxuVXDWHOl5BL3N-FmXhI9g4oBLtomfNoIxMN_DNXOgm2KUAyIALP9GvKTS8Co Oct 18 11:46:38.872466 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Id: None Oct 18 11:46:38.872466 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Name: None Oct 18 11:46:38.872466 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Identity-Status: Confirmed Oct 18 11:46:38.872466 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Is-Admin-Project: True Oct 18 11:46:38.872466 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Id: default Oct 18 11:46:38.872466 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Name: Default Oct 18 11:46:38.872466 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Id: ffc96760658d4e19af26d6cf22e94172 Oct 18 11:46:38.872466 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Name: tempest-AttachVolumeTestJSON-1223120040 Oct 18 11:46:38.872466 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Role: reader,member Oct 18 11:46:38.872466 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Roles: reader,member Oct 18 11:46:38.873964 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ffc96760658d4e19af26d6cf22e94172"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ffc96760658d4e19af26d6cf22e94172"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ffc96760658d4e19af26d6cf22e94172"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ffc96760658d4e19af26d6cf22e94172"}]}] Oct 18 11:46:38.873964 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant: tempest-AttachVolumeTestJSON-1223120040 Oct 18 11:46:38.873964 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Id: ffc96760658d4e19af26d6cf22e94172 Oct 18 11:46:38.873964 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1223120040 Oct 18 11:46:38.873964 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User: tempest-AttachVolumeTestJSON-1223120040-project Oct 18 11:46:38.873964 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Id: default Oct 18 11:46:38.873964 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Name: Default Oct 18 11:46:38.873964 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Id: bddd3d2bb8f647f2ba616141eb16622e Oct 18 11:46:38.873964 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Name: tempest-AttachVolumeTestJSON-1223120040-project Oct 18 11:46:38.873964 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: method: > Oct 18 11:46:38.873964 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: exception: Instance 96c06c00-7190-4ae9-a194-2d8f6123a781 could not be found. Oct 18 11:46:38.873964 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: action_args: {'id': '96c06c00-7190-4ae9-a194-2d8f6123a781'} Oct 18 11:46:38.874709 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:46:38.874709 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:46:38.874709 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:46:38.874709 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:46:38.874709 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:46:38.874709 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:46:38.874709 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:46:38.874709 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:46:38.874709 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:46:38.874709 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:46:38.874709 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96c06c00-7190-4ae9-a194-2d8f6123a781 could not be found. Oct 18 11:46:38.874709 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:46:38.874709 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:46:38.874709 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:46:38.874709 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:46:38.874709 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:46:38.874709 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:46:38.874709 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:46:38.874709 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:46:38.874709 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:46:38.875920 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:46:38.875920 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 11:46:38.875920 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 11:46:38.875920 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 11:46:38.875920 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 11:46:38.875920 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:46:38.875920 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:46:38.875920 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:46:38.875920 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:46:38.875920 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96c06c00-7190-4ae9-a194-2d8f6123a781 could not be found. Oct 18 11:46:38.875920 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:46:38.875920 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:46:38.875920 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:46:38.875920 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:46:38.875920 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:46:38.875920 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:46:38.875920 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:46:38.875920 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:46:38.875920 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96c06c00-7190-4ae9-a194-2d8f6123a781 could not be found. Oct 18 11:46:38.875920 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:46:38.878549 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-2b1f912a-5a45-4192-9e83-70077be6c3cd tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Returning 404 to user: Instance 96c06c00-7190-4ae9-a194-2d8f6123a781 could not be found. {{(pid=125486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:46:38.880269 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-2b1f912a-5a45-4192-9e83-70077be6c3cd tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "DELETE /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 404 len: 111 microversion: 2.1 time: 0.039351 Oct 18 11:46:38.881386 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 398/819] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Oct 18 11:46:38 2022] DELETE /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:46:38.890173 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-cd456501-9fc7-4e85-9dce-b2fb4e11fe65 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:38.890785 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-cd456501-9fc7-4e85-9dce-b2fb4e11fe65 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] [instance: 96c06c00-7190-4ae9-a194-2d8f6123a781] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:38.897259 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cd456501-9fc7-4e85-9dce-b2fb4e11fe65 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:38.897734 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cd456501-9fc7-4e85-9dce-b2fb4e11fe65 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:38.898368 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cd456501-9fc7-4e85-9dce-b2fb4e11fe65 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:38.899318 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cd456501-9fc7-4e85-9dce-b2fb4e11fe65 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:38.899960 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cd456501-9fc7-4e85-9dce-b2fb4e11fe65 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:38.900566 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cd456501-9fc7-4e85-9dce-b2fb4e11fe65 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:38.917453 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.wsgi [None req-cd456501-9fc7-4e85-9dce-b2fb4e11fe65 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] HTTP exception thrown: Instance 96c06c00-7190-4ae9-a194-2d8f6123a781 could not be found. Oct 18 11:46:38.919867 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-cd456501-9fc7-4e85-9dce-b2fb4e11fe65 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Request method failure captured: Oct 18 11:46:38.919867 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 HTTP/1.1 Oct 18 11:46:38.919867 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:46:38.919867 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:46:38.919867 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:46:38.919867 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 0 Oct 18 11:46:38.919867 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:46:38.919867 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:46:38.919867 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:46:38.919867 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:46:38.919867 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpCrIy4GzQCjUy1CRhpWWp69iHHeGG1rwC3C0zuL3UPG3bIyKSCl6QRRPIuq8bZKkzY01EOqQmpc6SwgfWY80EaHeb7Ws4uWGbs24InFMZsFWR6Z_kxuVXDWHOl5BL3N-FmXhI9g4oBLtomfNoIxMN_DNXOgm2KUAyIALP9GvKTS8Co Oct 18 11:46:38.919867 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:46:38.919867 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:46:38.919867 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:46:38.919867 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:46:38.919867 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:46:38.919867 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:46:38.919867 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: ffc96760658d4e19af26d6cf22e94172 Oct 18 11:46:38.919867 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-AttachVolumeTestJSON-1223120040 Oct 18 11:46:38.919867 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:46:38.919867 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:46:38.921899 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ffc96760658d4e19af26d6cf22e94172"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ffc96760658d4e19af26d6cf22e94172"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ffc96760658d4e19af26d6cf22e94172"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ffc96760658d4e19af26d6cf22e94172"}]}] Oct 18 11:46:38.921899 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-AttachVolumeTestJSON-1223120040 Oct 18 11:46:38.921899 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: ffc96760658d4e19af26d6cf22e94172 Oct 18 11:46:38.921899 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1223120040 Oct 18 11:46:38.921899 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-AttachVolumeTestJSON-1223120040-project Oct 18 11:46:38.921899 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:46:38.921899 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:46:38.921899 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: bddd3d2bb8f647f2ba616141eb16622e Oct 18 11:46:38.921899 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-AttachVolumeTestJSON-1223120040-project Oct 18 11:46:38.921899 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: > Oct 18 11:46:38.921899 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Instance 96c06c00-7190-4ae9-a194-2d8f6123a781 could not be found. Oct 18 11:46:38.921899 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'id': '96c06c00-7190-4ae9-a194-2d8f6123a781'} Oct 18 11:46:38.922677 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:46:38.922677 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:46:38.922677 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:46:38.922677 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:46:38.922677 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:46:38.922677 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:46:38.922677 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:46:38.922677 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:46:38.922677 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:46:38.922677 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:46:38.922677 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96c06c00-7190-4ae9-a194-2d8f6123a781 could not be found. Oct 18 11:46:38.922677 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:46:38.922677 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:46:38.922677 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:46:38.922677 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:46:38.922677 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:46:38.922677 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:46:38.922677 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:46:38.922677 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:46:38.922677 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:46:38.927467 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:46:38.927467 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 11:46:38.927467 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 11:46:38.927467 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:46:38.927467 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:46:38.927467 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:46:38.927467 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:46:38.927467 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96c06c00-7190-4ae9-a194-2d8f6123a781 could not be found. Oct 18 11:46:38.927467 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:46:38.927467 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:46:38.927467 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:46:38.927467 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:46:38.927467 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:46:38.927467 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:46:38.927467 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:46:38.927467 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:46:38.927467 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96c06c00-7190-4ae9-a194-2d8f6123a781 could not be found. Oct 18 11:46:38.927467 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:46:38.928562 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-cd456501-9fc7-4e85-9dce-b2fb4e11fe65 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] Returning 404 to user: Instance 96c06c00-7190-4ae9-a194-2d8f6123a781 could not be found. {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:46:38.928562 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-cd456501-9fc7-4e85-9dce-b2fb4e11fe65 tempest-AttachVolumeTestJSON-1223120040 tempest-AttachVolumeTestJSON-1223120040-project] 10.222.0.17 "GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781" status: 404 len: 111 microversion: 2.1 time: 0.036812 Oct 18 11:46:38.928562 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 422/820] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:46:38 2022] GET /compute/v2.1/servers/96c06c00-7190-4ae9-a194-2d8f6123a781 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:46:39.387908 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-54e74cb9-b27e-4789-a4c5-0c7726ecc6d9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:39.388691 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-54e74cb9-b27e-4789-a4c5-0c7726ecc6d9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:39.398718 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-54e74cb9-b27e-4789-a4c5-0c7726ecc6d9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:39.399214 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-54e74cb9-b27e-4789-a4c5-0c7726ecc6d9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:39.399676 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-54e74cb9-b27e-4789-a4c5-0c7726ecc6d9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:39.400370 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-54e74cb9-b27e-4789-a4c5-0c7726ecc6d9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:39.400823 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-54e74cb9-b27e-4789-a4c5-0c7726ecc6d9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:39.401276 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-54e74cb9-b27e-4789-a4c5-0c7726ecc6d9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:39.601451 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-54e74cb9-b27e-4789-a4c5-0c7726ecc6d9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:39.610522 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-54e74cb9-b27e-4789-a4c5-0c7726ecc6d9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:39.615951 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-54e74cb9-b27e-4789-a4c5-0c7726ecc6d9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:39.618556 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-54e74cb9-b27e-4789-a4c5-0c7726ecc6d9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1737 microversion: 2.20 time: 0.234821 Oct 18 11:46:39.619124 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 399/821] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:39 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1737 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:46:40.648260 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-5a952e6f-7f8d-487e-94ed-f4fd13794172 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:40.648901 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-5a952e6f-7f8d-487e-94ed-f4fd13794172 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:40.668773 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5a952e6f-7f8d-487e-94ed-f4fd13794172 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:40.670726 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5a952e6f-7f8d-487e-94ed-f4fd13794172 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:40.675601 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5a952e6f-7f8d-487e-94ed-f4fd13794172 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:40.677232 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5a952e6f-7f8d-487e-94ed-f4fd13794172 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:40.679555 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5a952e6f-7f8d-487e-94ed-f4fd13794172 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:40.683059 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5a952e6f-7f8d-487e-94ed-f4fd13794172 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:40.700127 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:46:41.020760 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-5a952e6f-7f8d-487e-94ed-f4fd13794172 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:41.037423 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-5a952e6f-7f8d-487e-94ed-f4fd13794172 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:41.040028 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-5a952e6f-7f8d-487e-94ed-f4fd13794172 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:41.042675 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-5a952e6f-7f8d-487e-94ed-f4fd13794172 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1737 microversion: 2.20 time: 0.398727 Oct 18 11:46:41.046794 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 423/822] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:40 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1737 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:46:42.073727 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-e008dc96-8c5d-4982-b97a-683577ed8bef tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:42.074344 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-e008dc96-8c5d-4982-b97a-683577ed8bef tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:42.085937 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:46:42.090895 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e008dc96-8c5d-4982-b97a-683577ed8bef tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:42.092951 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e008dc96-8c5d-4982-b97a-683577ed8bef tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:42.093597 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e008dc96-8c5d-4982-b97a-683577ed8bef tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:42.096343 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e008dc96-8c5d-4982-b97a-683577ed8bef tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:42.097093 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e008dc96-8c5d-4982-b97a-683577ed8bef tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:42.098266 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e008dc96-8c5d-4982-b97a-683577ed8bef tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:42.391995 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-e008dc96-8c5d-4982-b97a-683577ed8bef tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:42.406982 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-e008dc96-8c5d-4982-b97a-683577ed8bef tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:42.409438 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-e008dc96-8c5d-4982-b97a-683577ed8bef tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:42.412161 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-e008dc96-8c5d-4982-b97a-683577ed8bef tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1737 microversion: 2.20 time: 0.342255 Oct 18 11:46:42.428265 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 400/823] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:42 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1737 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:46:43.446488 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-49d679fd-6907-4602-938b-cf0c0468ac67 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:43.447101 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-49d679fd-6907-4602-938b-cf0c0468ac67 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:43.456682 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-49d679fd-6907-4602-938b-cf0c0468ac67 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:43.469037 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-49d679fd-6907-4602-938b-cf0c0468ac67 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:43.469037 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-49d679fd-6907-4602-938b-cf0c0468ac67 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:43.469037 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-49d679fd-6907-4602-938b-cf0c0468ac67 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:43.469037 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-49d679fd-6907-4602-938b-cf0c0468ac67 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:43.469751 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-49d679fd-6907-4602-938b-cf0c0468ac67 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:43.746028 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-49d679fd-6907-4602-938b-cf0c0468ac67 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:43.757686 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-49d679fd-6907-4602-938b-cf0c0468ac67 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:43.761035 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-49d679fd-6907-4602-938b-cf0c0468ac67 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:43.763057 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-49d679fd-6907-4602-938b-cf0c0468ac67 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1737 microversion: 2.20 time: 0.321900 Oct 18 11:46:43.764389 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 424/824] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:43 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1737 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:46:44.793592 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-c262d2e5-9f1d-482e-8be4-365a50a64ebd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:44.796688 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-c262d2e5-9f1d-482e-8be4-365a50a64ebd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:44.816350 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c262d2e5-9f1d-482e-8be4-365a50a64ebd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:44.816350 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c262d2e5-9f1d-482e-8be4-365a50a64ebd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:44.816350 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c262d2e5-9f1d-482e-8be4-365a50a64ebd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:44.816350 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c262d2e5-9f1d-482e-8be4-365a50a64ebd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:44.817485 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c262d2e5-9f1d-482e-8be4-365a50a64ebd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:44.817485 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c262d2e5-9f1d-482e-8be4-365a50a64ebd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:44.962578 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-c262d2e5-9f1d-482e-8be4-365a50a64ebd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:44.971307 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-c262d2e5-9f1d-482e-8be4-365a50a64ebd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:44.973037 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-c262d2e5-9f1d-482e-8be4-365a50a64ebd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:44.974374 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-c262d2e5-9f1d-482e-8be4-365a50a64ebd tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1737 microversion: 2.20 time: 0.187234 Oct 18 11:46:44.975126 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 401/825] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:44 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1737 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:46:46.001379 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-496bcd8e-2724-4db2-b57c-b7bd47dfe78d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:46.002095 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-496bcd8e-2724-4db2-b57c-b7bd47dfe78d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:46.008650 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-496bcd8e-2724-4db2-b57c-b7bd47dfe78d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:46.009246 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-496bcd8e-2724-4db2-b57c-b7bd47dfe78d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:46.009746 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-496bcd8e-2724-4db2-b57c-b7bd47dfe78d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:46.010437 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-496bcd8e-2724-4db2-b57c-b7bd47dfe78d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:46.010884 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-496bcd8e-2724-4db2-b57c-b7bd47dfe78d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:46.011306 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-496bcd8e-2724-4db2-b57c-b7bd47dfe78d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:46.144025 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-496bcd8e-2724-4db2-b57c-b7bd47dfe78d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:46.153151 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-496bcd8e-2724-4db2-b57c-b7bd47dfe78d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:46.154591 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-496bcd8e-2724-4db2-b57c-b7bd47dfe78d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:46.155818 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-496bcd8e-2724-4db2-b57c-b7bd47dfe78d tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1719 microversion: 2.20 time: 0.158325 Oct 18 11:46:46.156381 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 425/826] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:45 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:46:46.581771 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-e9e59b9b-677a-4318-8b34-3c660565feb8 tempest-VolumesTestJSON-1015121944 tempest-VolumesTestJSON-1015121944-project] Calling method '.version_select at 0x7f4bdbf5daf0>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:46.630256 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-e9e59b9b-677a-4318-8b34-3c660565feb8 tempest-VolumesTestJSON-1015121944 tempest-VolumesTestJSON-1015121944-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/91d15dcf-74aa-4310-88a2-e3fd9fbb41d0" status: 200 len: 351 microversion: 2.1 time: 0.052390 Oct 18 11:46:46.630823 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 402/827] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Oct 18 11:46:46 2022] GET /compute/v2.1/os-volumes/91d15dcf-74aa-4310-88a2-e3fd9fbb41d0 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:46:47.182280 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-4496d247-dff0-4094-be40-3e90d90622ce tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:47.182895 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-4496d247-dff0-4094-be40-3e90d90622ce tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:47.188815 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4496d247-dff0-4094-be40-3e90d90622ce tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:47.189336 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4496d247-dff0-4094-be40-3e90d90622ce tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:47.189770 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4496d247-dff0-4094-be40-3e90d90622ce tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:47.190463 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4496d247-dff0-4094-be40-3e90d90622ce tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:47.190916 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4496d247-dff0-4094-be40-3e90d90622ce tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:47.191337 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4496d247-dff0-4094-be40-3e90d90622ce tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:47.321769 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-4496d247-dff0-4094-be40-3e90d90622ce tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:47.329987 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-4496d247-dff0-4094-be40-3e90d90622ce tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:47.331421 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-4496d247-dff0-4094-be40-3e90d90622ce tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:47.332573 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-4496d247-dff0-4094-be40-3e90d90622ce tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1719 microversion: 2.20 time: 0.154482 Oct 18 11:46:47.333153 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 426/828] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:47 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:46:47.999552 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-41824865-8ce3-40b4-a3d1-90f23a02c7d9 tempest-VolumesTestJSON-1015121944 tempest-VolumesTestJSON-1015121944-project] Calling method '.version_select at 0x7f4bdbd98ee0>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:48.011293 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-c0372965-4a6f-4f8a-b146-55d7b9871159 req-e40399e8-5579-41a5-96c8-e5239e947e7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb2ccf2c-f9af-4953-90e6-88ab81961afe", "name": "network-vif-unplugged", "status": "completed", "tag": "f0fce60c-3686-40ed-8866-f0bdb6333f0a"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:46:48.023788 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-c0372965-4a6f-4f8a-b146-55d7b9871159 req-e40399e8-5579-41a5-96c8-e5239e947e7f service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:48.024544 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-c0372965-4a6f-4f8a-b146-55d7b9871159 req-e40399e8-5579-41a5-96c8-e5239e947e7f service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:48.025001 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-c0372965-4a6f-4f8a-b146-55d7b9871159 req-e40399e8-5579-41a5-96c8-e5239e947e7f service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:48.048616 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-c0372965-4a6f-4f8a-b146-55d7b9871159 req-e40399e8-5579-41a5-96c8-e5239e947e7f service nova] Creating event network-vif-unplugged:f0fce60c-3686-40ed-8866-f0bdb6333f0a for instance bb2ccf2c-f9af-4953-90e6-88ab81961afe on hv-cinder-81558 Oct 18 11:46:48.054530 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-c0372965-4a6f-4f8a-b146-55d7b9871159 req-e40399e8-5579-41a5-96c8-e5239e947e7f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047200 Oct 18 11:46:48.055774 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 427/829] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:46:48.081388 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-41824865-8ce3-40b4-a3d1-90f23a02c7d9 tempest-VolumesTestJSON-1015121944 tempest-VolumesTestJSON-1015121944-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/067ef879-9ec1-478b-8d0b-2bd6a9ea939d" status: 200 len: 351 microversion: 2.1 time: 0.085437 Oct 18 11:46:48.082684 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 403/830] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Oct 18 11:46:47 2022] GET /compute/v2.1/os-volumes/067ef879-9ec1-478b-8d0b-2bd6a9ea939d => generated 351 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:46:48.358660 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-cbfade95-44dc-421e-9d9b-dace2a410a1b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:48.360026 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-cbfade95-44dc-421e-9d9b-dace2a410a1b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:48.367437 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cbfade95-44dc-421e-9d9b-dace2a410a1b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:48.367991 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cbfade95-44dc-421e-9d9b-dace2a410a1b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:48.368344 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cbfade95-44dc-421e-9d9b-dace2a410a1b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:48.369047 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cbfade95-44dc-421e-9d9b-dace2a410a1b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:48.369536 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cbfade95-44dc-421e-9d9b-dace2a410a1b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:48.369962 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-cbfade95-44dc-421e-9d9b-dace2a410a1b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:48.498282 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-cbfade95-44dc-421e-9d9b-dace2a410a1b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:48.506946 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-cbfade95-44dc-421e-9d9b-dace2a410a1b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:48.508374 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-cbfade95-44dc-421e-9d9b-dace2a410a1b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:48.509568 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-cbfade95-44dc-421e-9d9b-dace2a410a1b tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1662 microversion: 2.20 time: 0.155127 Oct 18 11:46:48.510133 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 428/831] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:48 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1662 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:46:48.534137 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-6c951802-33f0-442b-a1ce-a935b2c73b5e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d269d494-eb48-4034-aa1c-455c2284f29d"}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:46:48.536542 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-6c951802-33f0-442b-a1ce-a935b2c73b5e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:48.543077 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6c951802-33f0-442b-a1ce-a935b2c73b5e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:48.543634 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6c951802-33f0-442b-a1ce-a935b2c73b5e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:48.544071 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6c951802-33f0-442b-a1ce-a935b2c73b5e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:48.544746 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6c951802-33f0-442b-a1ce-a935b2c73b5e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:48.545217 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6c951802-33f0-442b-a1ce-a935b2c73b5e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:48.545631 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6c951802-33f0-442b-a1ce-a935b2c73b5e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:48.804870 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-6c951802-33f0-442b-a1ce-a935b2c73b5e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "POST /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.274826 Oct 18 11:46:48.805664 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 404/832] 10.222.0.17 () {62 vars in 1364 bytes} [Tue Oct 18 11:46:48 2022] POST /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe/os-volume_attachments => generated 188 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 11:46:48.931272 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-0bc8131b-4c6e-4a20-a9bd-e5acd8f6105f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:48.931802 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-0bc8131b-4c6e-4a20-a9bd-e5acd8f6105f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:48.938469 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0bc8131b-4c6e-4a20-a9bd-e5acd8f6105f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:48.938942 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0bc8131b-4c6e-4a20-a9bd-e5acd8f6105f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:48.939368 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0bc8131b-4c6e-4a20-a9bd-e5acd8f6105f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:48.940040 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0bc8131b-4c6e-4a20-a9bd-e5acd8f6105f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:48.940487 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0bc8131b-4c6e-4a20-a9bd-e5acd8f6105f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:48.940920 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0bc8131b-4c6e-4a20-a9bd-e5acd8f6105f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:48.964628 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-01f2a77c-12eb-4b23-9b9e-3fb6de151a2c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:48.965231 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-01f2a77c-12eb-4b23-9b9e-3fb6de151a2c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 736e19d9-edb8-4f3d-93c0-0a3e59c395fd] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:48.971134 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-01f2a77c-12eb-4b23-9b9e-3fb6de151a2c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:48.971609 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-01f2a77c-12eb-4b23-9b9e-3fb6de151a2c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:48.972038 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-01f2a77c-12eb-4b23-9b9e-3fb6de151a2c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:48.972725 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-01f2a77c-12eb-4b23-9b9e-3fb6de151a2c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:48.973307 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-01f2a77c-12eb-4b23-9b9e-3fb6de151a2c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:48.973723 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-01f2a77c-12eb-4b23-9b9e-3fb6de151a2c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:48.997261 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-01f2a77c-12eb-4b23-9b9e-3fb6de151a2c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd/ips" status: 200 len: 148 microversion: 2.1 time: 0.036437 Oct 18 11:46:48.997821 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 405/833] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Oct 18 11:46:48 2022] GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:46:51.056428 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-0bc8131b-4c6e-4a20-a9bd-e5acd8f6105f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe/os-volume_attachments/d269d494-eb48-4034-aa1c-455c2284f29d" status: 202 len: 0 microversion: 2.20 time: 2.129032 Oct 18 11:46:51.057037 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 429/834] 10.222.0.17 () {60 vars in 1457 bytes} [Tue Oct 18 11:46:48 2022] DELETE /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe/os-volume_attachments/d269d494-eb48-4034-aa1c-455c2284f29d => generated 0 bytes in 2130 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 11:46:51.216328 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-0a6d06ca-6bc2-4bae-bae2-4ab123af0707 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:46:51.216994 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-0a6d06ca-6bc2-4bae-bae2-4ab123af0707 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:51.223487 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0a6d06ca-6bc2-4bae-bae2-4ab123af0707 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:51.224001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0a6d06ca-6bc2-4bae-bae2-4ab123af0707 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:51.224477 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0a6d06ca-6bc2-4bae-bae2-4ab123af0707 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:51.225171 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0a6d06ca-6bc2-4bae-bae2-4ab123af0707 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:51.225618 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0a6d06ca-6bc2-4bae-bae2-4ab123af0707 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:51.226040 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0a6d06ca-6bc2-4bae-bae2-4ab123af0707 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:51.269686 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-0a6d06ca-6bc2-4bae-bae2-4ab123af0707 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125486) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 18 11:46:51.344811 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-0a6d06ca-6bc2-4bae-bae2-4ab123af0707 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "POST /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe/action" status: 202 len: 0 microversion: 2.20 time: 0.132529 Oct 18 11:46:51.353653 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-0cf45620-701e-4de3-a4fc-e5c5622822e0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:51.354268 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-0cf45620-701e-4de3-a4fc-e5c5622822e0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:51.359392 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 406/835] 10.222.0.17 () {62 vars in 1319 bytes} [Tue Oct 18 11:46:51 2022] POST /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 11:46:51.362336 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0cf45620-701e-4de3-a4fc-e5c5622822e0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:51.362336 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0cf45620-701e-4de3-a4fc-e5c5622822e0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:51.362336 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0cf45620-701e-4de3-a4fc-e5c5622822e0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:51.364434 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0cf45620-701e-4de3-a4fc-e5c5622822e0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:51.364434 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0cf45620-701e-4de3-a4fc-e5c5622822e0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:51.364434 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0cf45620-701e-4de3-a4fc-e5c5622822e0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:51.416263 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-685d4996-00cc-4264-8487-f397f31a8f0c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d10b3338-8bb3-4792-96cc-138471c6390b"}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:46:51.419292 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-685d4996-00cc-4264-8487-f397f31a8f0c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 736e19d9-edb8-4f3d-93c0-0a3e59c395fd] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:51.431803 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-685d4996-00cc-4264-8487-f397f31a8f0c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:51.433574 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-685d4996-00cc-4264-8487-f397f31a8f0c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:51.434205 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-685d4996-00cc-4264-8487-f397f31a8f0c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:51.435172 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-685d4996-00cc-4264-8487-f397f31a8f0c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:51.435785 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-685d4996-00cc-4264-8487-f397f31a8f0c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:51.436369 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-685d4996-00cc-4264-8487-f397f31a8f0c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:51.522725 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-0cf45620-701e-4de3-a4fc-e5c5622822e0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:51.531654 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-0cf45620-701e-4de3-a4fc-e5c5622822e0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:51.533123 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-0cf45620-701e-4de3-a4fc-e5c5622822e0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:51.534549 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-0cf45620-701e-4de3-a4fc-e5c5622822e0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1670 microversion: 2.20 time: 0.184595 Oct 18 11:46:51.535325 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 430/836] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:51 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1670 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:46:51.554582 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-840f4aee-4d35-4fa3-8ca3-c3e2eb0b6a69 tempest-VolumesTestJSON-1015121944 tempest-VolumesTestJSON-1015121944-project] Calling method '.version_select at 0x7f4bdbdcdee0>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:51.608926 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-840f4aee-4d35-4fa3-8ca3-c3e2eb0b6a69 tempest-VolumesTestJSON-1015121944 tempest-VolumesTestJSON-1015121944-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/38ced9f9-da10-481b-a662-98f577b5f255" status: 200 len: 351 microversion: 2.1 time: 0.058603 Oct 18 11:46:51.609502 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 431/837] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Oct 18 11:46:51 2022] GET /compute/v2.1/os-volumes/38ced9f9-da10-481b-a662-98f577b5f255 => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:46:51.622506 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-c423b202-22cd-4ad4-8e0c-99bd67acedc0 tempest-VolumesTestJSON-1015121944 tempest-VolumesTestJSON-1015121944-project] Calling method '.version_select at 0x7f4bdbdc1430>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:51.714417 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-c423b202-22cd-4ad4-8e0c-99bd67acedc0 tempest-VolumesTestJSON-1015121944 tempest-VolumesTestJSON-1015121944-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.095474 Oct 18 11:46:51.715098 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 432/838] 10.222.0.17 () {58 vars in 1134 bytes} [Tue Oct 18 11:46:51 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:46:51.729401 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-afc41155-9512-4ed6-878a-6a9fb6b032b8 tempest-VolumesTestJSON-1015121944 tempest-VolumesTestJSON-1015121944-project] Calling method '.version_select at 0x7f4bdbddc3a0>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:51.736716 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-685d4996-00cc-4264-8487-f397f31a8f0c tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "POST /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324997 Oct 18 11:46:51.737378 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 407/839] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Oct 18 11:46:51 2022] POST /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:46:51.822345 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-afc41155-9512-4ed6-878a-6a9fb6b032b8 tempest-VolumesTestJSON-1015121944 tempest-VolumesTestJSON-1015121944-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.096205 Oct 18 11:46:51.823198 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 433/840] 10.222.0.17 () {58 vars in 1149 bytes} [Tue Oct 18 11:46:51 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:46:51.838299 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-b7234294-4d1f-4a75-9582-d978c5d19eae tempest-VolumesTestJSON-1015121944 tempest-VolumesTestJSON-1015121944-project] Calling method '.version_select at 0x7f4bdbdde3a0>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:51.931708 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-b7234294-4d1f-4a75-9582-d978c5d19eae tempest-VolumesTestJSON-1015121944 tempest-VolumesTestJSON-1015121944-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.098201 Oct 18 11:46:51.932500 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 408/841] 10.222.0.17 () {58 vars in 1134 bytes} [Tue Oct 18 11:46:51 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:51.946820 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-eb3f8fb4-2f97-400c-8cc2-59371ccf490d tempest-VolumesTestJSON-1015121944 tempest-VolumesTestJSON-1015121944-project] Calling method '.version_select at 0x7f4bdbdc1d30>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:52.042113 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-eb3f8fb4-2f97-400c-8cc2-59371ccf490d tempest-VolumesTestJSON-1015121944 tempest-VolumesTestJSON-1015121944-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.099141 Oct 18 11:46:52.043125 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 434/842] 10.222.0.17 () {58 vars in 1167 bytes} [Tue Oct 18 11:46:51 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:46:52.059907 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-32e7cca2-a12f-4d0e-ad52-627d6ddc0654 tempest-VolumesTestJSON-1015121944 tempest-VolumesTestJSON-1015121944-project] Calling method '.version_select at 0x7f4bdbd2e430>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:52.144613 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-32e7cca2-a12f-4d0e-ad52-627d6ddc0654 tempest-VolumesTestJSON-1015121944 tempest-VolumesTestJSON-1015121944-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.089572 Oct 18 11:46:52.145219 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 409/843] 10.222.0.17 () {58 vars in 1170 bytes} [Tue Oct 18 11:46:52 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:46:52.158599 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-04adc483-bbf2-4da3-93a7-2922cdf6245a tempest-VolumesTestJSON-1015121944 tempest-VolumesTestJSON-1015121944-project] Calling method '.version_select at 0x7f4bdbe1e940>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:52.249517 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-04adc483-bbf2-4da3-93a7-2922cdf6245a tempest-VolumesTestJSON-1015121944 tempest-VolumesTestJSON-1015121944-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.094522 Oct 18 11:46:52.250113 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 435/844] 10.222.0.17 () {58 vars in 1155 bytes} [Tue Oct 18 11:46:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:52.263842 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-4c3db1f9-64d6-4387-b36c-3cb1936348de tempest-VolumesTestJSON-1015121944 tempest-VolumesTestJSON-1015121944-project] Calling method '.version_select at 0x7f4bdbf87790>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:52.350525 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-4c3db1f9-64d6-4387-b36c-3cb1936348de tempest-VolumesTestJSON-1015121944 tempest-VolumesTestJSON-1015121944-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.090823 Oct 18 11:46:52.351327 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 410/845] 10.222.0.17 () {58 vars in 1188 bytes} [Tue Oct 18 11:46:52 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:46:52.364589 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-6bc8f690-e12c-4b41-adfc-278a751fb958 tempest-VolumesTestJSON-1015121944 tempest-VolumesTestJSON-1015121944-project] Calling method '.version_select at 0x7f4bdbddc5e0>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:52.446297 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-6bc8f690-e12c-4b41-adfc-278a751fb958 tempest-VolumesTestJSON-1015121944 tempest-VolumesTestJSON-1015121944-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.085281 Oct 18 11:46:52.446903 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 436/846] 10.222.0.17 () {58 vars in 1155 bytes} [Tue Oct 18 11:46:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:46:52.569108 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-7c8085fa-ee78-4343-926f-5b3b044e644e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:52.570051 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-7c8085fa-ee78-4343-926f-5b3b044e644e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:52.580782 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7c8085fa-ee78-4343-926f-5b3b044e644e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:52.581275 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7c8085fa-ee78-4343-926f-5b3b044e644e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:52.582697 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7c8085fa-ee78-4343-926f-5b3b044e644e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:52.583091 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7c8085fa-ee78-4343-926f-5b3b044e644e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:52.583538 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7c8085fa-ee78-4343-926f-5b3b044e644e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:52.583956 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7c8085fa-ee78-4343-926f-5b3b044e644e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:52.588229 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:46:52.769044 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-7c8085fa-ee78-4343-926f-5b3b044e644e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:52.778051 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-7c8085fa-ee78-4343-926f-5b3b044e644e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:52.779520 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-7c8085fa-ee78-4343-926f-5b3b044e644e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:52.780693 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-7c8085fa-ee78-4343-926f-5b3b044e644e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1728 microversion: 2.20 time: 0.216366 Oct 18 11:46:52.781405 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 411/847] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:52 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1728 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:46:53.808140 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-690828af-edf8-4302-9fb9-4340b0af95c0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:53.808888 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-690828af-edf8-4302-9fb9-4340b0af95c0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:53.819210 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-690828af-edf8-4302-9fb9-4340b0af95c0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:53.821002 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-690828af-edf8-4302-9fb9-4340b0af95c0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:53.821902 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-690828af-edf8-4302-9fb9-4340b0af95c0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:53.826326 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-690828af-edf8-4302-9fb9-4340b0af95c0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:53.827657 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-690828af-edf8-4302-9fb9-4340b0af95c0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:53.828248 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-690828af-edf8-4302-9fb9-4340b0af95c0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:54.132768 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-690828af-edf8-4302-9fb9-4340b0af95c0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:54.142575 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-690828af-edf8-4302-9fb9-4340b0af95c0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:54.145106 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-690828af-edf8-4302-9fb9-4340b0af95c0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:54.146458 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-690828af-edf8-4302-9fb9-4340b0af95c0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1728 microversion: 2.20 time: 0.342575 Oct 18 11:46:54.147757 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 437/848] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:53 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1728 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:46:55.173857 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-4950a6b9-bcb3-4e4e-a80f-6eafd89810d4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:55.174620 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-4950a6b9-bcb3-4e4e-a80f-6eafd89810d4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:55.181504 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4950a6b9-bcb3-4e4e-a80f-6eafd89810d4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:55.181997 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4950a6b9-bcb3-4e4e-a80f-6eafd89810d4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:55.182434 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4950a6b9-bcb3-4e4e-a80f-6eafd89810d4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:55.183154 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4950a6b9-bcb3-4e4e-a80f-6eafd89810d4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:55.183602 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4950a6b9-bcb3-4e4e-a80f-6eafd89810d4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:55.184026 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4950a6b9-bcb3-4e4e-a80f-6eafd89810d4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:55.338837 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-4950a6b9-bcb3-4e4e-a80f-6eafd89810d4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:55.347754 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-4950a6b9-bcb3-4e4e-a80f-6eafd89810d4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:55.349627 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-4950a6b9-bcb3-4e4e-a80f-6eafd89810d4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:55.350780 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-4950a6b9-bcb3-4e4e-a80f-6eafd89810d4 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1728 microversion: 2.20 time: 0.181588 Oct 18 11:46:55.351335 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 412/849] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:55 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:46:56.376655 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-336ed641-a70d-44ae-8dd4-9e9231fa108e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:56.378032 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-336ed641-a70d-44ae-8dd4-9e9231fa108e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:56.384998 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-336ed641-a70d-44ae-8dd4-9e9231fa108e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:56.385632 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-336ed641-a70d-44ae-8dd4-9e9231fa108e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:56.386172 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-336ed641-a70d-44ae-8dd4-9e9231fa108e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:56.386985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-336ed641-a70d-44ae-8dd4-9e9231fa108e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:56.387541 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-336ed641-a70d-44ae-8dd4-9e9231fa108e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:56.388062 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-336ed641-a70d-44ae-8dd4-9e9231fa108e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:56.612983 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-336ed641-a70d-44ae-8dd4-9e9231fa108e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:56.621552 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-336ed641-a70d-44ae-8dd4-9e9231fa108e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:56.623502 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-336ed641-a70d-44ae-8dd4-9e9231fa108e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:56.625031 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-336ed641-a70d-44ae-8dd4-9e9231fa108e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1728 microversion: 2.20 time: 0.252203 Oct 18 11:46:56.626257 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 438/850] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:56 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1728 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:46:57.653125 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-b630636f-294a-4294-934b-a1cb107923ad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:57.654362 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-b630636f-294a-4294-934b-a1cb107923ad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:57.662515 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b630636f-294a-4294-934b-a1cb107923ad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:57.662999 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b630636f-294a-4294-934b-a1cb107923ad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:57.663428 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b630636f-294a-4294-934b-a1cb107923ad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:57.664114 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b630636f-294a-4294-934b-a1cb107923ad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:57.664558 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b630636f-294a-4294-934b-a1cb107923ad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:57.665082 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b630636f-294a-4294-934b-a1cb107923ad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:57.818461 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-b630636f-294a-4294-934b-a1cb107923ad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:57.827203 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-b630636f-294a-4294-934b-a1cb107923ad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:57.828933 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-b630636f-294a-4294-934b-a1cb107923ad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:57.830291 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-b630636f-294a-4294-934b-a1cb107923ad tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1728 microversion: 2.20 time: 0.181155 Oct 18 11:46:57.833201 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 413/851] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:57 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1728 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:46:58.857541 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-5b9da85b-48f6-4014-8e51-99476761529f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:46:58.858223 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-5b9da85b-48f6-4014-8e51-99476761529f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:46:58.865468 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5b9da85b-48f6-4014-8e51-99476761529f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:58.865951 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5b9da85b-48f6-4014-8e51-99476761529f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:58.866396 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5b9da85b-48f6-4014-8e51-99476761529f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:58.867084 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5b9da85b-48f6-4014-8e51-99476761529f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:46:58.867524 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5b9da85b-48f6-4014-8e51-99476761529f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:46:58.867938 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-5b9da85b-48f6-4014-8e51-99476761529f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:46:59.012276 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-5b9da85b-48f6-4014-8e51-99476761529f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:59.021527 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-5b9da85b-48f6-4014-8e51-99476761529f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:59.022970 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-5b9da85b-48f6-4014-8e51-99476761529f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:46:59.024139 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-5b9da85b-48f6-4014-8e51-99476761529f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1728 microversion: 2.20 time: 0.171343 Oct 18 11:46:59.037669 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 439/852] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:46:58 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1728 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:47:00.051066 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-37b315e0-92d6-43fe-a9dd-f6451e6df1a0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:47:00.052448 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-37b315e0-92d6-43fe-a9dd-f6451e6df1a0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:47:00.059085 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-37b315e0-92d6-43fe-a9dd-f6451e6df1a0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:00.059766 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-37b315e0-92d6-43fe-a9dd-f6451e6df1a0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:00.060469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-37b315e0-92d6-43fe-a9dd-f6451e6df1a0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:00.061357 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-37b315e0-92d6-43fe-a9dd-f6451e6df1a0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:00.061958 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-37b315e0-92d6-43fe-a9dd-f6451e6df1a0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:00.062556 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-37b315e0-92d6-43fe-a9dd-f6451e6df1a0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:00.208137 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-37b315e0-92d6-43fe-a9dd-f6451e6df1a0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:00.218459 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-37b315e0-92d6-43fe-a9dd-f6451e6df1a0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:00.219896 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-37b315e0-92d6-43fe-a9dd-f6451e6df1a0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:00.221099 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-37b315e0-92d6-43fe-a9dd-f6451e6df1a0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1728 microversion: 2.20 time: 0.174209 Oct 18 11:47:00.221874 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 414/853] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:47:00 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:47:01.247099 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-d56993f0-507b-4362-bdeb-af16d22c7c56 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:47:01.248384 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-d56993f0-507b-4362-bdeb-af16d22c7c56 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:47:01.255224 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d56993f0-507b-4362-bdeb-af16d22c7c56 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:01.255945 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d56993f0-507b-4362-bdeb-af16d22c7c56 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:01.256560 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d56993f0-507b-4362-bdeb-af16d22c7c56 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:01.262395 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d56993f0-507b-4362-bdeb-af16d22c7c56 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:01.262877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d56993f0-507b-4362-bdeb-af16d22c7c56 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:01.263315 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d56993f0-507b-4362-bdeb-af16d22c7c56 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:01.422715 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-d56993f0-507b-4362-bdeb-af16d22c7c56 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:01.433360 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-d56993f0-507b-4362-bdeb-af16d22c7c56 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:01.435040 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-d56993f0-507b-4362-bdeb-af16d22c7c56 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:01.436445 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-d56993f0-507b-4362-bdeb-af16d22c7c56 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1728 microversion: 2.20 time: 0.193265 Oct 18 11:47:01.437079 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 440/854] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:47:01 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1728 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:47:02.464248 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-cc5a3571-16dd-4d42-8107-c3696034d2fc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:47:02.464931 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-cc5a3571-16dd-4d42-8107-c3696034d2fc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:47:02.471268 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cc5a3571-16dd-4d42-8107-c3696034d2fc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:02.471784 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cc5a3571-16dd-4d42-8107-c3696034d2fc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:02.472218 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cc5a3571-16dd-4d42-8107-c3696034d2fc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:02.472918 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cc5a3571-16dd-4d42-8107-c3696034d2fc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:02.473371 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cc5a3571-16dd-4d42-8107-c3696034d2fc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:02.473789 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cc5a3571-16dd-4d42-8107-c3696034d2fc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:02.601714 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-cc5a3571-16dd-4d42-8107-c3696034d2fc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:02.609761 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-cc5a3571-16dd-4d42-8107-c3696034d2fc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:02.611203 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-cc5a3571-16dd-4d42-8107-c3696034d2fc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:02.612895 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-cc5a3571-16dd-4d42-8107-c3696034d2fc tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1728 microversion: 2.20 time: 0.152080 Oct 18 11:47:02.613453 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 415/855] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:47:02 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:47:03.638660 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-9b9dfd24-4f47-418b-b908-8beccebbb8da tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:47:03.639269 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-9b9dfd24-4f47-418b-b908-8beccebbb8da tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:47:03.645615 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9b9dfd24-4f47-418b-b908-8beccebbb8da tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:03.646096 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9b9dfd24-4f47-418b-b908-8beccebbb8da tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:03.646531 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9b9dfd24-4f47-418b-b908-8beccebbb8da tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:03.647211 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9b9dfd24-4f47-418b-b908-8beccebbb8da tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:03.647668 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9b9dfd24-4f47-418b-b908-8beccebbb8da tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:03.648087 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9b9dfd24-4f47-418b-b908-8beccebbb8da tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:03.776244 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-9b9dfd24-4f47-418b-b908-8beccebbb8da tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:03.784776 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-9b9dfd24-4f47-418b-b908-8beccebbb8da tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:03.786222 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-9b9dfd24-4f47-418b-b908-8beccebbb8da tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:03.787371 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-9b9dfd24-4f47-418b-b908-8beccebbb8da tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1728 microversion: 2.20 time: 0.152582 Oct 18 11:47:03.787924 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 441/856] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:47:03 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:47:04.813565 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-d5566cfb-ee1f-4dcc-b33e-a37e853354ba tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:47:04.814169 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-d5566cfb-ee1f-4dcc-b33e-a37e853354ba tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:47:04.820472 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d5566cfb-ee1f-4dcc-b33e-a37e853354ba tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:04.820988 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d5566cfb-ee1f-4dcc-b33e-a37e853354ba tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:04.821420 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d5566cfb-ee1f-4dcc-b33e-a37e853354ba tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:04.822089 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d5566cfb-ee1f-4dcc-b33e-a37e853354ba tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:04.822535 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d5566cfb-ee1f-4dcc-b33e-a37e853354ba tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:04.822948 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d5566cfb-ee1f-4dcc-b33e-a37e853354ba tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:05.204521 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-d5566cfb-ee1f-4dcc-b33e-a37e853354ba tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:05.213228 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-d5566cfb-ee1f-4dcc-b33e-a37e853354ba tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:05.214659 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-d5566cfb-ee1f-4dcc-b33e-a37e853354ba tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:05.215806 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-d5566cfb-ee1f-4dcc-b33e-a37e853354ba tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1728 microversion: 2.20 time: 0.406212 Oct 18 11:47:05.216369 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 416/857] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:47:04 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1728 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:47:06.243306 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-aca78a26-4ed5-4602-8a42-567efde61428 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:47:06.245310 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-aca78a26-4ed5-4602-8a42-567efde61428 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:47:06.249780 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:47:06.257573 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-aca78a26-4ed5-4602-8a42-567efde61428 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:06.258063 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-aca78a26-4ed5-4602-8a42-567efde61428 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:06.258963 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-aca78a26-4ed5-4602-8a42-567efde61428 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:06.259673 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-aca78a26-4ed5-4602-8a42-567efde61428 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:06.261256 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-aca78a26-4ed5-4602-8a42-567efde61428 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:06.262315 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-aca78a26-4ed5-4602-8a42-567efde61428 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:06.405466 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-aca78a26-4ed5-4602-8a42-567efde61428 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:06.414050 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-aca78a26-4ed5-4602-8a42-567efde61428 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:06.415485 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-aca78a26-4ed5-4602-8a42-567efde61428 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:06.416637 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-aca78a26-4ed5-4602-8a42-567efde61428 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1728 microversion: 2.20 time: 0.179630 Oct 18 11:47:06.417239 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 442/858] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:47:06 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:47:06.972397 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-359a8160-b7ef-4641-9b15-ed53e8fca9d5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:47:06.972912 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-359a8160-b7ef-4641-9b15-ed53e8fca9d5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 736e19d9-edb8-4f3d-93c0-0a3e59c395fd] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:47:06.979232 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-359a8160-b7ef-4641-9b15-ed53e8fca9d5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:06.979715 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-359a8160-b7ef-4641-9b15-ed53e8fca9d5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:06.980149 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-359a8160-b7ef-4641-9b15-ed53e8fca9d5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:06.980832 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-359a8160-b7ef-4641-9b15-ed53e8fca9d5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:06.981309 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-359a8160-b7ef-4641-9b15-ed53e8fca9d5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:06.981736 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-359a8160-b7ef-4641-9b15-ed53e8fca9d5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:07.062435 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.objects.instance [None req-359a8160-b7ef-4641-9b15-ed53e8fca9d5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lazy-loading 'services' on Instance uuid 736e19d9-edb8-4f3d-93c0-0a3e59c395fd {{(pid=125486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:47:07.132651 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-359a8160-b7ef-4641-9b15-ed53e8fca9d5 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "DELETE /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd/os-volume_attachments/d10b3338-8bb3-4792-96cc-138471c6390b" status: 202 len: 0 microversion: 2.1 time: 0.164126 Oct 18 11:47:07.133286 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 417/859] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Oct 18 11:47:06 2022] DELETE /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd/os-volume_attachments/d10b3338-8bb3-4792-96cc-138471c6390b => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 11:47:07.142634 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-f80f59dc-43fd-4214-938e-d29c919e6345 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:47:07.144827 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-f80f59dc-43fd-4214-938e-d29c919e6345 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 736e19d9-edb8-4f3d-93c0-0a3e59c395fd] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:47:07.152788 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f80f59dc-43fd-4214-938e-d29c919e6345 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:07.153657 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f80f59dc-43fd-4214-938e-d29c919e6345 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:07.154877 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f80f59dc-43fd-4214-938e-d29c919e6345 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:07.156759 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f80f59dc-43fd-4214-938e-d29c919e6345 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:07.156759 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f80f59dc-43fd-4214-938e-d29c919e6345 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:07.157750 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f80f59dc-43fd-4214-938e-d29c919e6345 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:07.201195 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-f80f59dc-43fd-4214-938e-d29c919e6345 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063254 Oct 18 11:47:07.202374 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 443/860] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Oct 18 11:47:07 2022] GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:47:07.442249 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-6430cde3-f2e7-43b6-b696-b5c48e8e60e9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:47:07.443080 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-6430cde3-f2e7-43b6-b696-b5c48e8e60e9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:47:07.450047 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6430cde3-f2e7-43b6-b696-b5c48e8e60e9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:07.450609 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6430cde3-f2e7-43b6-b696-b5c48e8e60e9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:07.451053 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6430cde3-f2e7-43b6-b696-b5c48e8e60e9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:07.451772 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6430cde3-f2e7-43b6-b696-b5c48e8e60e9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:07.452228 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6430cde3-f2e7-43b6-b696-b5c48e8e60e9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:07.452651 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-6430cde3-f2e7-43b6-b696-b5c48e8e60e9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:07.582367 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-6430cde3-f2e7-43b6-b696-b5c48e8e60e9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:07.590876 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-6430cde3-f2e7-43b6-b696-b5c48e8e60e9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:07.592306 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-6430cde3-f2e7-43b6-b696-b5c48e8e60e9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:07.593521 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-6430cde3-f2e7-43b6-b696-b5c48e8e60e9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1728 microversion: 2.20 time: 0.155566 Oct 18 11:47:07.594204 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 418/861] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:47:07 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:47:08.171541 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-f0c0afb7-3fb2-4cdf-92a7-eb542e16b8f2 req-ccf61d76-3c67-4e4d-87b3-f9460e67eaf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb2ccf2c-f9af-4953-90e6-88ab81961afe", "name": "network-vif-plugged", "status": "completed", "tag": "f0fce60c-3686-40ed-8866-f0bdb6333f0a"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:47:08.183216 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-f0c0afb7-3fb2-4cdf-92a7-eb542e16b8f2 req-ccf61d76-3c67-4e4d-87b3-f9460e67eaf3 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:08.184639 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-f0c0afb7-3fb2-4cdf-92a7-eb542e16b8f2 req-ccf61d76-3c67-4e4d-87b3-f9460e67eaf3 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:08.185090 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-f0c0afb7-3fb2-4cdf-92a7-eb542e16b8f2 req-ccf61d76-3c67-4e4d-87b3-f9460e67eaf3 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:08.189371 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:47:08.198065 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-f0c0afb7-3fb2-4cdf-92a7-eb542e16b8f2 req-ccf61d76-3c67-4e4d-87b3-f9460e67eaf3 service nova] Creating event network-vif-plugged:f0fce60c-3686-40ed-8866-f0bdb6333f0a for instance bb2ccf2c-f9af-4953-90e6-88ab81961afe on hv-cinder-81558 Oct 18 11:47:08.203547 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-f0c0afb7-3fb2-4cdf-92a7-eb542e16b8f2 req-ccf61d76-3c67-4e4d-87b3-f9460e67eaf3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036147 Oct 18 11:47:08.204135 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 444/862] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:47:08.231392 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-cbda47a2-b9e1-4b35-a255-03a250839cae tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:47:08.234017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-cbda47a2-b9e1-4b35-a255-03a250839cae tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 736e19d9-edb8-4f3d-93c0-0a3e59c395fd] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:47:08.241364 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cbda47a2-b9e1-4b35-a255-03a250839cae tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:08.241918 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cbda47a2-b9e1-4b35-a255-03a250839cae tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:08.242503 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cbda47a2-b9e1-4b35-a255-03a250839cae tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:08.243325 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cbda47a2-b9e1-4b35-a255-03a250839cae tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:08.243958 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cbda47a2-b9e1-4b35-a255-03a250839cae tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:08.244555 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cbda47a2-b9e1-4b35-a255-03a250839cae tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:08.274962 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-cbda47a2-b9e1-4b35-a255-03a250839cae tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047949 Oct 18 11:47:08.275525 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 419/863] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Oct 18 11:47:08 2022] GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 11:47:08.359435 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-7e52a18d-a2ec-43a3-aebb-57bac0bb474f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:47:08.360020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-7e52a18d-a2ec-43a3-aebb-57bac0bb474f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 736e19d9-edb8-4f3d-93c0-0a3e59c395fd] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:47:08.368103 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7e52a18d-a2ec-43a3-aebb-57bac0bb474f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:08.368590 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7e52a18d-a2ec-43a3-aebb-57bac0bb474f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:08.369057 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7e52a18d-a2ec-43a3-aebb-57bac0bb474f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:08.369762 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7e52a18d-a2ec-43a3-aebb-57bac0bb474f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:08.370215 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7e52a18d-a2ec-43a3-aebb-57bac0bb474f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:08.370636 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-7e52a18d-a2ec-43a3-aebb-57bac0bb474f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:08.397848 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-7e52a18d-a2ec-43a3-aebb-57bac0bb474f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 736e19d9-edb8-4f3d-93c0-0a3e59c395fd] Going to try to terminate instance {{(pid=125485) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 11:47:08.474161 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-7e52a18d-a2ec-43a3-aebb-57bac0bb474f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "DELETE /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd" status: 204 len: 0 microversion: 2.1 time: 0.120145 Oct 18 11:47:08.474744 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 445/864] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Oct 18 11:47:08 2022] DELETE /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 11:47:08.482858 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-a99ca358-11d5-4295-b870-cd4d20e91e07 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:47:08.483476 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-a99ca358-11d5-4295-b870-cd4d20e91e07 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 736e19d9-edb8-4f3d-93c0-0a3e59c395fd] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:47:08.489445 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a99ca358-11d5-4295-b870-cd4d20e91e07 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:08.489922 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a99ca358-11d5-4295-b870-cd4d20e91e07 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:08.490350 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a99ca358-11d5-4295-b870-cd4d20e91e07 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:08.491029 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a99ca358-11d5-4295-b870-cd4d20e91e07 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:08.491472 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a99ca358-11d5-4295-b870-cd4d20e91e07 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:08.491898 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a99ca358-11d5-4295-b870-cd4d20e91e07 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:08.619819 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-9367930c-928f-495c-a14f-666d00d3e017 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:47:08.620277 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-a99ca358-11d5-4295-b870-cd4d20e91e07 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:08.620507 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-9367930c-928f-495c-a14f-666d00d3e017 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:47:08.626393 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9367930c-928f-495c-a14f-666d00d3e017 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:08.626865 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9367930c-928f-495c-a14f-666d00d3e017 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:08.627310 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9367930c-928f-495c-a14f-666d00d3e017 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:08.627994 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9367930c-928f-495c-a14f-666d00d3e017 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:08.628156 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-a99ca358-11d5-4295-b870-cd4d20e91e07 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd" status: 200 len: 1681 microversion: 2.1 time: 0.149172 Oct 18 11:47:08.628438 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9367930c-928f-495c-a14f-666d00d3e017 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:08.628719 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 420/865] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:47:08 2022] GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:47:08.630672 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9367930c-928f-495c-a14f-666d00d3e017 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:08.770216 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-9367930c-928f-495c-a14f-666d00d3e017 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:08.778503 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-9367930c-928f-495c-a14f-666d00d3e017 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:08.779931 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-9367930c-928f-495c-a14f-666d00d3e017 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:08.781106 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-9367930c-928f-495c-a14f-666d00d3e017 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1728 microversion: 2.20 time: 0.165742 Oct 18 11:47:08.781657 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 446/866] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:47:08 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:47:09.651762 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-8ba79799-0dca-480e-ae3d-63cde0bcce95 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:47:09.652375 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-8ba79799-0dca-480e-ae3d-63cde0bcce95 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 736e19d9-edb8-4f3d-93c0-0a3e59c395fd] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:47:09.658550 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8ba79799-0dca-480e-ae3d-63cde0bcce95 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:09.659063 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8ba79799-0dca-480e-ae3d-63cde0bcce95 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:09.659500 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8ba79799-0dca-480e-ae3d-63cde0bcce95 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:09.660190 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8ba79799-0dca-480e-ae3d-63cde0bcce95 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:09.660829 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8ba79799-0dca-480e-ae3d-63cde0bcce95 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:09.661282 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-8ba79799-0dca-480e-ae3d-63cde0bcce95 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:09.806413 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-0680f721-a2bf-48d5-aa4f-14a8cff65c15 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:47:09.807017 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-0680f721-a2bf-48d5-aa4f-14a8cff65c15 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:47:09.813767 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0680f721-a2bf-48d5-aa4f-14a8cff65c15 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:09.814252 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0680f721-a2bf-48d5-aa4f-14a8cff65c15 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:09.814696 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0680f721-a2bf-48d5-aa4f-14a8cff65c15 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:09.815890 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0680f721-a2bf-48d5-aa4f-14a8cff65c15 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:09.816534 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0680f721-a2bf-48d5-aa4f-14a8cff65c15 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:09.816986 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0680f721-a2bf-48d5-aa4f-14a8cff65c15 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:09.833979 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-8ba79799-0dca-480e-ae3d-63cde0bcce95 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:09.841874 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-8ba79799-0dca-480e-ae3d-63cde0bcce95 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd" status: 200 len: 1681 microversion: 2.1 time: 0.193950 Oct 18 11:47:09.842539 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 421/867] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:47:09 2022] GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd => generated 1681 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:47:09.963146 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-0680f721-a2bf-48d5-aa4f-14a8cff65c15 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:09.971187 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-0680f721-a2bf-48d5-aa4f-14a8cff65c15 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:09.972640 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-0680f721-a2bf-48d5-aa4f-14a8cff65c15 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:09.973838 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-0680f721-a2bf-48d5-aa4f-14a8cff65c15 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1728 microversion: 2.20 time: 0.171565 Oct 18 11:47:09.985038 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 447/868] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:47:09 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:47:10.865232 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-900b089c-9f28-4ddb-abeb-90444a8f2bdd tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:47:10.866468 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-900b089c-9f28-4ddb-abeb-90444a8f2bdd tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 736e19d9-edb8-4f3d-93c0-0a3e59c395fd] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:47:10.872938 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-900b089c-9f28-4ddb-abeb-90444a8f2bdd tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:10.873421 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-900b089c-9f28-4ddb-abeb-90444a8f2bdd tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:10.873850 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-900b089c-9f28-4ddb-abeb-90444a8f2bdd tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:10.874535 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-900b089c-9f28-4ddb-abeb-90444a8f2bdd tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:10.874973 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-900b089c-9f28-4ddb-abeb-90444a8f2bdd tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:10.875566 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-900b089c-9f28-4ddb-abeb-90444a8f2bdd tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:11.001447 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-21cc5aeb-3518-4643-8f89-298915428ab9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:47:11.004362 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-21cc5aeb-3518-4643-8f89-298915428ab9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:47:11.016076 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-21cc5aeb-3518-4643-8f89-298915428ab9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:11.017344 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-21cc5aeb-3518-4643-8f89-298915428ab9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:11.018824 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-21cc5aeb-3518-4643-8f89-298915428ab9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:11.020023 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-21cc5aeb-3518-4643-8f89-298915428ab9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:11.020748 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-21cc5aeb-3518-4643-8f89-298915428ab9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:11.022980 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-21cc5aeb-3518-4643-8f89-298915428ab9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:11.184314 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-900b089c-9f28-4ddb-abeb-90444a8f2bdd tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:11.196538 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-900b089c-9f28-4ddb-abeb-90444a8f2bdd tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd" status: 200 len: 1681 microversion: 2.1 time: 0.332942 Oct 18 11:47:11.197039 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 422/869] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:47:10 2022] GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd => generated 1681 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:47:11.227988 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-21cc5aeb-3518-4643-8f89-298915428ab9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:11.249216 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-21cc5aeb-3518-4643-8f89-298915428ab9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:11.256047 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-21cc5aeb-3518-4643-8f89-298915428ab9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:11.258160 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-21cc5aeb-3518-4643-8f89-298915428ab9 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1728 microversion: 2.20 time: 0.262985 Oct 18 11:47:11.261914 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 448/870] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:47:10 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1728 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:47:11.717495 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-eb9eae6a-09d7-43bd-9861-90028b6f4a17 req-872feb98-6da4-4f3f-83b9-1a8088f7b049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "736e19d9-edb8-4f3d-93c0-0a3e59c395fd", "name": "network-vif-deleted", "tag": "3c5dcfc4-904b-4c1f-9715-95cec1d6e317"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:47:11.729948 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-eb9eae6a-09d7-43bd-9861-90028b6f4a17 req-872feb98-6da4-4f3f-83b9-1a8088f7b049 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:11.730427 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-eb9eae6a-09d7-43bd-9861-90028b6f4a17 req-872feb98-6da4-4f3f-83b9-1a8088f7b049 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:11.730850 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-eb9eae6a-09d7-43bd-9861-90028b6f4a17 req-872feb98-6da4-4f3f-83b9-1a8088f7b049 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:11.743467 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-eb9eae6a-09d7-43bd-9861-90028b6f4a17 req-872feb98-6da4-4f3f-83b9-1a8088f7b049 service nova] Creating event network-vif-deleted:3c5dcfc4-904b-4c1f-9715-95cec1d6e317 for instance 736e19d9-edb8-4f3d-93c0-0a3e59c395fd on hv-cinder-81558 Oct 18 11:47:11.749096 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-eb9eae6a-09d7-43bd-9861-90028b6f4a17 req-872feb98-6da4-4f3f-83b9-1a8088f7b049 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035652 Oct 18 11:47:11.756093 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 423/871] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:47:12.220764 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-bdb1bd66-66ab-4013-87d5-a19399fb716d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:47:12.221752 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-bdb1bd66-66ab-4013-87d5-a19399fb716d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 736e19d9-edb8-4f3d-93c0-0a3e59c395fd] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:47:12.229898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bdb1bd66-66ab-4013-87d5-a19399fb716d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:12.230461 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bdb1bd66-66ab-4013-87d5-a19399fb716d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:12.230963 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bdb1bd66-66ab-4013-87d5-a19399fb716d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:12.231895 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bdb1bd66-66ab-4013-87d5-a19399fb716d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:12.232435 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bdb1bd66-66ab-4013-87d5-a19399fb716d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:12.232955 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bdb1bd66-66ab-4013-87d5-a19399fb716d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:12.271803 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bdb1bd66-66ab-4013-87d5-a19399fb716d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:12.272297 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bdb1bd66-66ab-4013-87d5-a19399fb716d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:12.273016 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bdb1bd66-66ab-4013-87d5-a19399fb716d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:12.273469 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.objects.instance [None req-bdb1bd66-66ab-4013-87d5-a19399fb716d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lazy-loading 'fault' on Instance uuid 736e19d9-edb8-4f3d-93c0-0a3e59c395fd {{(pid=125485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:47:12.288374 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-4550944d-0b9e-47fa-8070-b579b27af8f7 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:47:12.289078 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-4550944d-0b9e-47fa-8070-b579b27af8f7 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:47:12.297169 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:47:12.302517 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4550944d-0b9e-47fa-8070-b579b27af8f7 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:12.303743 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4550944d-0b9e-47fa-8070-b579b27af8f7 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:12.304324 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4550944d-0b9e-47fa-8070-b579b27af8f7 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:12.305124 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4550944d-0b9e-47fa-8070-b579b27af8f7 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:12.305752 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4550944d-0b9e-47fa-8070-b579b27af8f7 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:12.306428 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4550944d-0b9e-47fa-8070-b579b27af8f7 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:12.334128 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-bdb1bd66-66ab-4013-87d5-a19399fb716d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916699a212eb4d8aa945f299ac0d4c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633afaabbbff47a4a99ebc997e67b01a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:12.347222 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-bdb1bd66-66ab-4013-87d5-a19399fb716d tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd" status: 200 len: 1332 microversion: 2.1 time: 0.128053 Oct 18 11:47:12.350159 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 449/872] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:47:12 2022] GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd => generated 1332 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:47:12.478572 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-4550944d-0b9e-47fa-8070-b579b27af8f7 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:12.487885 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-4550944d-0b9e-47fa-8070-b579b27af8f7 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:12.489750 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-4550944d-0b9e-47fa-8070-b579b27af8f7 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:47:12.491105 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-4550944d-0b9e-47fa-8070-b579b27af8f7 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1715 microversion: 2.20 time: 0.208003 Oct 18 11:47:12.492043 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 424/873] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:47:12 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1715 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 11:47:13.374081 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-d5b4fbee-078a-487a-9465-269496620c81 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:47:13.374690 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-d5b4fbee-078a-487a-9465-269496620c81 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 736e19d9-edb8-4f3d-93c0-0a3e59c395fd] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:47:13.381881 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d5b4fbee-078a-487a-9465-269496620c81 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:13.382363 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d5b4fbee-078a-487a-9465-269496620c81 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:13.382800 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d5b4fbee-078a-487a-9465-269496620c81 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:13.383484 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d5b4fbee-078a-487a-9465-269496620c81 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:13.383931 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d5b4fbee-078a-487a-9465-269496620c81 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:13.384366 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d5b4fbee-078a-487a-9465-269496620c81 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:13.398025 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.wsgi [None req-d5b4fbee-078a-487a-9465-269496620c81 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] HTTP exception thrown: Instance 736e19d9-edb8-4f3d-93c0-0a3e59c395fd could not be found. Oct 18 11:47:13.399685 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-d5b4fbee-078a-487a-9465-269496620c81 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Request method failure captured: Oct 18 11:47:13.399685 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd HTTP/1.1 Oct 18 11:47:13.399685 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:47:13.399685 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:47:13.399685 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:47:13.399685 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 0 Oct 18 11:47:13.399685 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:47:13.399685 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:47:13.399685 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:47:13.399685 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:47:13.399685 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpC0QX2SvHowI5-vz58GDwpVMERgGiI-pqt2GQ4o1fdQFbeIrfuLVtcw55IWYTDh91fNo1KVKFcag_YfGjslSHmWVAe8eH9iiMTcKmdOtt4MUEPPWZ9OQcF5wlXB0WJP-XHDUtk0mAsVICaitUhEDH7cqfrNMho4FbOB0yKZgk6M4Ns Oct 18 11:47:13.399685 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:47:13.399685 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:47:13.399685 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:47:13.399685 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:47:13.399685 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:47:13.399685 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:47:13.399685 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: 633afaabbbff47a4a99ebc997e67b01a Oct 18 11:47:13.399685 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:47:13.399685 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:47:13.399685 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:47:13.401455 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/633afaabbbff47a4a99ebc997e67b01a"}]}] Oct 18 11:47:13.401455 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:47:13.401455 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: 633afaabbbff47a4a99ebc997e67b01a Oct 18 11:47:13.401455 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:47:13.401455 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-AttachVolumeNegativeTest-1091652349-project Oct 18 11:47:13.401455 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:47:13.401455 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:47:13.401455 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: 916699a212eb4d8aa945f299ac0d4c96 Oct 18 11:47:13.401455 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-AttachVolumeNegativeTest-1091652349-project Oct 18 11:47:13.401455 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: > Oct 18 11:47:13.401455 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Instance 736e19d9-edb8-4f3d-93c0-0a3e59c395fd could not be found. Oct 18 11:47:13.401455 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'id': '736e19d9-edb8-4f3d-93c0-0a3e59c395fd'} Oct 18 11:47:13.402444 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:47:13.402444 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:47:13.402444 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:47:13.402444 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:47:13.402444 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:47:13.402444 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:47:13.402444 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:47:13.402444 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:47:13.402444 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:47:13.402444 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:47:13.402444 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 736e19d9-edb8-4f3d-93c0-0a3e59c395fd could not be found. Oct 18 11:47:13.402444 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:47:13.402444 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:47:13.402444 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:47:13.402444 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:47:13.402444 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:47:13.402444 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:47:13.402444 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:47:13.402444 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:47:13.402444 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:47:13.404053 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:47:13.404053 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 11:47:13.404053 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 11:47:13.404053 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:47:13.404053 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:47:13.404053 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:47:13.404053 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:47:13.404053 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 736e19d9-edb8-4f3d-93c0-0a3e59c395fd could not be found. Oct 18 11:47:13.404053 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:47:13.404053 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:47:13.404053 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:47:13.404053 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:47:13.404053 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:47:13.404053 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:47:13.404053 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:47:13.404053 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:47:13.404053 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 736e19d9-edb8-4f3d-93c0-0a3e59c395fd could not be found. Oct 18 11:47:13.404053 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:47:13.405550 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-d5b4fbee-078a-487a-9465-269496620c81 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Returning 404 to user: Instance 736e19d9-edb8-4f3d-93c0-0a3e59c395fd could not be found. {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:47:13.405550 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-d5b4fbee-078a-487a-9465-269496620c81 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd" status: 404 len: 111 microversion: 2.1 time: 0.030919 Oct 18 11:47:13.405550 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 450/874] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:47:13 2022] GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:47:13.410511 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-eb2a5ac3-d5a6-4b97-b3f5-36584870450b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '.version_select at 0x7f4bdbf4f790>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:47:13.429370 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-eb2a5ac3-d5a6-4b97-b3f5-36584870450b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1999600117" status: 202 len: 0 microversion: 2.1 time: 0.022705 Oct 18 11:47:13.429955 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 425/875] 10.222.0.17 () {58 vars in 1221 bytes} [Tue Oct 18 11:47:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1999600117 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 11:47:15.242261 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-16cf22a1-d973-4760-86f2-657d527080f7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:47:15.242824 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-16cf22a1-d973-4760-86f2-657d527080f7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 736e19d9-edb8-4f3d-93c0-0a3e59c395fd] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:47:15.249327 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-16cf22a1-d973-4760-86f2-657d527080f7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:15.249738 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-16cf22a1-d973-4760-86f2-657d527080f7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:15.250170 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-16cf22a1-d973-4760-86f2-657d527080f7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:15.250879 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-16cf22a1-d973-4760-86f2-657d527080f7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:15.251325 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-16cf22a1-d973-4760-86f2-657d527080f7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:15.251782 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-16cf22a1-d973-4760-86f2-657d527080f7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:15.265876 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.wsgi [None req-16cf22a1-d973-4760-86f2-657d527080f7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] HTTP exception thrown: Instance 736e19d9-edb8-4f3d-93c0-0a3e59c395fd could not be found. Oct 18 11:47:15.267400 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-16cf22a1-d973-4760-86f2-657d527080f7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Request method failure captured: Oct 18 11:47:15.267400 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: DELETE /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd HTTP/1.1 Oct 18 11:47:15.267400 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:47:15.267400 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:47:15.267400 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:47:15.267400 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 0 Oct 18 11:47:15.267400 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:47:15.267400 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:47:15.267400 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:47:15.267400 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:47:15.267400 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpC0QX2SvHowI5-vz58GDwpVMERgGiI-pqt2GQ4o1fdQFbeIrfuLVtcw55IWYTDh91fNo1KVKFcag_YfGjslSHmWVAe8eH9iiMTcKmdOtt4MUEPPWZ9OQcF5wlXB0WJP-XHDUtk0mAsVICaitUhEDH7cqfrNMho4FbOB0yKZgk6M4Ns Oct 18 11:47:15.267400 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:47:15.267400 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:47:15.267400 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:47:15.267400 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:47:15.267400 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:47:15.267400 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:47:15.267400 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: 633afaabbbff47a4a99ebc997e67b01a Oct 18 11:47:15.267400 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:47:15.267400 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:47:15.267400 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:47:15.269504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/633afaabbbff47a4a99ebc997e67b01a"}]}] Oct 18 11:47:15.269504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:47:15.269504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: 633afaabbbff47a4a99ebc997e67b01a Oct 18 11:47:15.269504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:47:15.269504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-AttachVolumeNegativeTest-1091652349-project Oct 18 11:47:15.269504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:47:15.269504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:47:15.269504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: 916699a212eb4d8aa945f299ac0d4c96 Oct 18 11:47:15.269504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-AttachVolumeNegativeTest-1091652349-project Oct 18 11:47:15.269504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: > Oct 18 11:47:15.269504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Instance 736e19d9-edb8-4f3d-93c0-0a3e59c395fd could not be found. Oct 18 11:47:15.269504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'id': '736e19d9-edb8-4f3d-93c0-0a3e59c395fd'} Oct 18 11:47:15.270370 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:47:15.270370 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:47:15.270370 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:47:15.270370 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:47:15.270370 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:47:15.270370 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:47:15.270370 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:47:15.270370 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:47:15.270370 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:47:15.270370 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:47:15.270370 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 736e19d9-edb8-4f3d-93c0-0a3e59c395fd could not be found. Oct 18 11:47:15.270370 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:47:15.270370 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:47:15.270370 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:47:15.270370 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:47:15.270370 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:47:15.270370 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:47:15.270370 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:47:15.270370 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:47:15.270370 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:47:15.271596 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:47:15.271596 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 11:47:15.271596 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 11:47:15.271596 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 11:47:15.271596 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 11:47:15.271596 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:47:15.271596 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:47:15.271596 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:47:15.271596 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:47:15.271596 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 736e19d9-edb8-4f3d-93c0-0a3e59c395fd could not be found. Oct 18 11:47:15.271596 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:47:15.271596 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:47:15.271596 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:47:15.271596 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:47:15.271596 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:47:15.271596 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:47:15.271596 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:47:15.271596 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:47:15.271596 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 736e19d9-edb8-4f3d-93c0-0a3e59c395fd could not be found. Oct 18 11:47:15.271596 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:47:15.272857 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-16cf22a1-d973-4760-86f2-657d527080f7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Returning 404 to user: Instance 736e19d9-edb8-4f3d-93c0-0a3e59c395fd could not be found. {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:47:15.272857 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-16cf22a1-d973-4760-86f2-657d527080f7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "DELETE /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd" status: 404 len: 111 microversion: 2.1 time: 0.031644 Oct 18 11:47:15.272857 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 451/876] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Oct 18 11:47:15 2022] DELETE /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:47:15.278628 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-810925df-1e36-4d61-b0c0-3cffda1a1b12 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:47:15.279244 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-810925df-1e36-4d61-b0c0-3cffda1a1b12 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 736e19d9-edb8-4f3d-93c0-0a3e59c395fd] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:47:15.286740 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-810925df-1e36-4d61-b0c0-3cffda1a1b12 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:15.287223 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-810925df-1e36-4d61-b0c0-3cffda1a1b12 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:15.287660 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-810925df-1e36-4d61-b0c0-3cffda1a1b12 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:15.288349 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-810925df-1e36-4d61-b0c0-3cffda1a1b12 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:15.288804 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-810925df-1e36-4d61-b0c0-3cffda1a1b12 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:15.289252 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-810925df-1e36-4d61-b0c0-3cffda1a1b12 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:15.302210 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.wsgi [None req-810925df-1e36-4d61-b0c0-3cffda1a1b12 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] HTTP exception thrown: Instance 736e19d9-edb8-4f3d-93c0-0a3e59c395fd could not be found. Oct 18 11:47:15.303856 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-810925df-1e36-4d61-b0c0-3cffda1a1b12 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Request method failure captured: Oct 18 11:47:15.303856 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: request: GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd HTTP/1.1 Oct 18 11:47:15.303856 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept: application/json Oct 18 11:47:15.303856 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept-Encoding: identity Oct 18 11:47:15.303856 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Connection: close Oct 18 11:47:15.303856 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Length: 0 Oct 18 11:47:15.303856 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Type: application/json Oct 18 11:47:15.303856 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Host: 10.222.0.17 Oct 18 11:47:15.303856 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Openstack-System-Scope: None Oct 18 11:47:15.303856 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: User-Agent: python-urllib3/1.26.12 Oct 18 11:47:15.303856 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Auth-Token: gAAAAABjTpC0QX2SvHowI5-vz58GDwpVMERgGiI-pqt2GQ4o1fdQFbeIrfuLVtcw55IWYTDh91fNo1KVKFcag_YfGjslSHmWVAe8eH9iiMTcKmdOtt4MUEPPWZ9OQcF5wlXB0WJP-XHDUtk0mAsVICaitUhEDH7cqfrNMho4FbOB0yKZgk6M4Ns Oct 18 11:47:15.303856 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Id: None Oct 18 11:47:15.303856 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Name: None Oct 18 11:47:15.303856 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Identity-Status: Confirmed Oct 18 11:47:15.303856 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Is-Admin-Project: True Oct 18 11:47:15.303856 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Id: default Oct 18 11:47:15.303856 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Name: Default Oct 18 11:47:15.303856 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Id: 633afaabbbff47a4a99ebc997e67b01a Oct 18 11:47:15.303856 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Name: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:47:15.303856 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Role: reader,member Oct 18 11:47:15.303856 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Roles: reader,member Oct 18 11:47:15.305478 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/633afaabbbff47a4a99ebc997e67b01a"}]}] Oct 18 11:47:15.305478 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:47:15.305478 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Id: 633afaabbbff47a4a99ebc997e67b01a Oct 18 11:47:15.305478 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:47:15.305478 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User: tempest-AttachVolumeNegativeTest-1091652349-project Oct 18 11:47:15.305478 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Id: default Oct 18 11:47:15.305478 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Name: Default Oct 18 11:47:15.305478 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Id: 916699a212eb4d8aa945f299ac0d4c96 Oct 18 11:47:15.305478 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Name: tempest-AttachVolumeNegativeTest-1091652349-project Oct 18 11:47:15.305478 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: method: > Oct 18 11:47:15.305478 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: exception: Instance 736e19d9-edb8-4f3d-93c0-0a3e59c395fd could not be found. Oct 18 11:47:15.305478 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: action_args: {'id': '736e19d9-edb8-4f3d-93c0-0a3e59c395fd'} Oct 18 11:47:15.306351 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:47:15.306351 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:47:15.306351 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:47:15.306351 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:47:15.306351 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:47:15.306351 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:47:15.306351 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:47:15.306351 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:47:15.306351 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:47:15.306351 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:47:15.306351 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 736e19d9-edb8-4f3d-93c0-0a3e59c395fd could not be found. Oct 18 11:47:15.306351 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:47:15.306351 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:47:15.306351 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:47:15.306351 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:47:15.306351 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:47:15.306351 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:47:15.306351 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:47:15.306351 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:47:15.306351 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:47:15.307814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:47:15.307814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 11:47:15.307814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 11:47:15.307814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:47:15.307814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:47:15.307814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:47:15.307814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:47:15.307814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 736e19d9-edb8-4f3d-93c0-0a3e59c395fd could not be found. Oct 18 11:47:15.307814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:47:15.307814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:47:15.307814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:47:15.307814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:47:15.307814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:47:15.307814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:47:15.307814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:47:15.307814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:47:15.307814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 736e19d9-edb8-4f3d-93c0-0a3e59c395fd could not be found. Oct 18 11:47:15.307814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:47:15.309133 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-810925df-1e36-4d61-b0c0-3cffda1a1b12 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Returning 404 to user: Instance 736e19d9-edb8-4f3d-93c0-0a3e59c395fd could not be found. {{(pid=125486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:47:15.309133 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-810925df-1e36-4d61-b0c0-3cffda1a1b12 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd" status: 404 len: 111 microversion: 2.1 time: 0.031154 Oct 18 11:47:15.309133 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 426/877] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:47:15 2022] GET /compute/v2.1/servers/736e19d9-edb8-4f3d-93c0-0a3e59c395fd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:47:16.447348 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-692fcece-5382-465d-b7f6-0668f403530b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:47:16.447916 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-692fcece-5382-465d-b7f6-0668f403530b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:47:16.454860 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-692fcece-5382-465d-b7f6-0668f403530b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:16.455337 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-692fcece-5382-465d-b7f6-0668f403530b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:16.455768 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-692fcece-5382-465d-b7f6-0668f403530b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:16.456452 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-692fcece-5382-465d-b7f6-0668f403530b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:16.456928 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-692fcece-5382-465d-b7f6-0668f403530b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:16.457351 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-692fcece-5382-465d-b7f6-0668f403530b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:16.473299 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.wsgi [None req-692fcece-5382-465d-b7f6-0668f403530b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] HTTP exception thrown: Instance 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a could not be found. Oct 18 11:47:16.474831 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-692fcece-5382-465d-b7f6-0668f403530b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Request method failure captured: Oct 18 11:47:16.474831 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: DELETE /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a HTTP/1.1 Oct 18 11:47:16.474831 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:47:16.474831 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:47:16.474831 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:47:16.474831 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 0 Oct 18 11:47:16.474831 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:47:16.474831 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:47:16.474831 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:47:16.474831 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:47:16.474831 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpC0QX2SvHowI5-vz58GDwpVMERgGiI-pqt2GQ4o1fdQFbeIrfuLVtcw55IWYTDh91fNo1KVKFcag_YfGjslSHmWVAe8eH9iiMTcKmdOtt4MUEPPWZ9OQcF5wlXB0WJP-XHDUtk0mAsVICaitUhEDH7cqfrNMho4FbOB0yKZgk6M4Ns Oct 18 11:47:16.474831 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:47:16.474831 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:47:16.474831 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:47:16.474831 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:47:16.474831 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:47:16.474831 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:47:16.474831 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: 633afaabbbff47a4a99ebc997e67b01a Oct 18 11:47:16.474831 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:47:16.474831 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:47:16.474831 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:47:16.476578 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/633afaabbbff47a4a99ebc997e67b01a"}]}] Oct 18 11:47:16.476578 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:47:16.476578 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: 633afaabbbff47a4a99ebc997e67b01a Oct 18 11:47:16.476578 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:47:16.476578 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-AttachVolumeNegativeTest-1091652349-project Oct 18 11:47:16.476578 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:47:16.476578 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:47:16.476578 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: 916699a212eb4d8aa945f299ac0d4c96 Oct 18 11:47:16.476578 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-AttachVolumeNegativeTest-1091652349-project Oct 18 11:47:16.476578 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: > Oct 18 11:47:16.476578 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Instance 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a could not be found. Oct 18 11:47:16.476578 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'id': '8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a'} Oct 18 11:47:16.480192 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:47:16.480192 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:47:16.480192 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:47:16.480192 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:47:16.480192 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:47:16.480192 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:47:16.480192 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:47:16.480192 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:47:16.480192 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:47:16.480192 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:47:16.480192 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a could not be found. Oct 18 11:47:16.480192 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:47:16.480192 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:47:16.480192 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:47:16.480192 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:47:16.480192 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:47:16.480192 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:47:16.480192 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:47:16.480192 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:47:16.480192 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:47:16.481755 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:47:16.481755 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 11:47:16.481755 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 11:47:16.481755 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 11:47:16.481755 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 11:47:16.481755 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:47:16.481755 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:47:16.481755 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:47:16.481755 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:47:16.481755 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a could not be found. Oct 18 11:47:16.481755 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:47:16.481755 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:47:16.481755 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:47:16.481755 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:47:16.481755 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:47:16.481755 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:47:16.481755 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:47:16.481755 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:47:16.481755 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a could not be found. Oct 18 11:47:16.481755 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:47:16.483225 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-692fcece-5382-465d-b7f6-0668f403530b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Returning 404 to user: Instance 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a could not be found. {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:47:16.483225 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-692fcece-5382-465d-b7f6-0668f403530b tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a" status: 404 len: 111 microversion: 2.1 time: 0.032955 Oct 18 11:47:16.483225 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 452/878] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Oct 18 11:47:16 2022] DELETE /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:47:16.485429 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-58e2bbf5-c534-4e7e-870a-af92de46af2f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:47:16.486090 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-58e2bbf5-c534-4e7e-870a-af92de46af2f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:47:16.493187 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-58e2bbf5-c534-4e7e-870a-af92de46af2f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:16.493614 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-58e2bbf5-c534-4e7e-870a-af92de46af2f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:16.494052 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-58e2bbf5-c534-4e7e-870a-af92de46af2f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:16.494816 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-58e2bbf5-c534-4e7e-870a-af92de46af2f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:16.495212 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-58e2bbf5-c534-4e7e-870a-af92de46af2f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:16.495768 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-58e2bbf5-c534-4e7e-870a-af92de46af2f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:16.509949 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.wsgi [None req-58e2bbf5-c534-4e7e-870a-af92de46af2f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] HTTP exception thrown: Instance 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a could not be found. Oct 18 11:47:16.511465 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-58e2bbf5-c534-4e7e-870a-af92de46af2f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Request method failure captured: Oct 18 11:47:16.511465 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: request: GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a HTTP/1.1 Oct 18 11:47:16.511465 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept: application/json Oct 18 11:47:16.511465 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept-Encoding: identity Oct 18 11:47:16.511465 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Connection: close Oct 18 11:47:16.511465 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Length: 0 Oct 18 11:47:16.511465 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Type: application/json Oct 18 11:47:16.511465 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Host: 10.222.0.17 Oct 18 11:47:16.511465 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Openstack-System-Scope: None Oct 18 11:47:16.511465 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: User-Agent: python-urllib3/1.26.12 Oct 18 11:47:16.511465 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Auth-Token: gAAAAABjTpC0QX2SvHowI5-vz58GDwpVMERgGiI-pqt2GQ4o1fdQFbeIrfuLVtcw55IWYTDh91fNo1KVKFcag_YfGjslSHmWVAe8eH9iiMTcKmdOtt4MUEPPWZ9OQcF5wlXB0WJP-XHDUtk0mAsVICaitUhEDH7cqfrNMho4FbOB0yKZgk6M4Ns Oct 18 11:47:16.511465 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Id: None Oct 18 11:47:16.511465 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Name: None Oct 18 11:47:16.511465 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Identity-Status: Confirmed Oct 18 11:47:16.511465 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Is-Admin-Project: True Oct 18 11:47:16.511465 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Id: default Oct 18 11:47:16.511465 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Name: Default Oct 18 11:47:16.511465 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Id: 633afaabbbff47a4a99ebc997e67b01a Oct 18 11:47:16.511465 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Name: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:47:16.511465 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Role: reader,member Oct 18 11:47:16.511465 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Roles: reader,member Oct 18 11:47:16.513094 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/633afaabbbff47a4a99ebc997e67b01a"}]}] Oct 18 11:47:16.513094 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:47:16.513094 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Id: 633afaabbbff47a4a99ebc997e67b01a Oct 18 11:47:16.513094 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:47:16.513094 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User: tempest-AttachVolumeNegativeTest-1091652349-project Oct 18 11:47:16.513094 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Id: default Oct 18 11:47:16.513094 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Name: Default Oct 18 11:47:16.513094 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Id: 916699a212eb4d8aa945f299ac0d4c96 Oct 18 11:47:16.513094 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Name: tempest-AttachVolumeNegativeTest-1091652349-project Oct 18 11:47:16.513094 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: method: > Oct 18 11:47:16.513094 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: exception: Instance 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a could not be found. Oct 18 11:47:16.513094 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: action_args: {'id': '8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a'} Oct 18 11:47:16.513986 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:47:16.513986 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:47:16.513986 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:47:16.513986 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:47:16.513986 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:47:16.513986 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:47:16.513986 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:47:16.513986 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:47:16.513986 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:47:16.513986 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:47:16.513986 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a could not be found. Oct 18 11:47:16.513986 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:47:16.513986 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:47:16.513986 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:47:16.513986 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:47:16.513986 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:47:16.513986 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:47:16.513986 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:47:16.513986 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:47:16.513986 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:47:16.515469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:47:16.515469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 11:47:16.515469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 11:47:16.515469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:47:16.515469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:47:16.515469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:47:16.515469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:47:16.515469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a could not be found. Oct 18 11:47:16.515469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:47:16.515469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:47:16.515469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:47:16.515469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:47:16.515469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:47:16.515469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:47:16.515469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:47:16.515469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:47:16.515469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a could not be found. Oct 18 11:47:16.515469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:47:16.516765 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-58e2bbf5-c534-4e7e-870a-af92de46af2f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Returning 404 to user: Instance 8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a could not be found. {{(pid=125486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:47:16.516765 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-58e2bbf5-c534-4e7e-870a-af92de46af2f tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a" status: 404 len: 111 microversion: 2.1 time: 0.031333 Oct 18 11:47:16.516765 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 427/879] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:47:16 2022] GET /compute/v2.1/servers/8a3ada5f-5ec3-4d2e-bd64-f7b1d056899a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:47:16.522201 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-a1473fac-a4f6-410f-b7c9-2131b8e78c56 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:47:16.522711 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-a1473fac-a4f6-410f-b7c9-2131b8e78c56 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:47:16.528644 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a1473fac-a4f6-410f-b7c9-2131b8e78c56 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:16.529165 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a1473fac-a4f6-410f-b7c9-2131b8e78c56 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:16.529599 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a1473fac-a4f6-410f-b7c9-2131b8e78c56 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:16.530353 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a1473fac-a4f6-410f-b7c9-2131b8e78c56 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:16.530736 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a1473fac-a4f6-410f-b7c9-2131b8e78c56 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:16.531155 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a1473fac-a4f6-410f-b7c9-2131b8e78c56 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:16.692369 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.wsgi [None req-a1473fac-a4f6-410f-b7c9-2131b8e78c56 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] HTTP exception thrown: Instance 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 could not be found. Oct 18 11:47:16.693935 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-a1473fac-a4f6-410f-b7c9-2131b8e78c56 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Request method failure captured: Oct 18 11:47:16.693935 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: DELETE /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 HTTP/1.1 Oct 18 11:47:16.693935 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:47:16.693935 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:47:16.693935 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:47:16.693935 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 0 Oct 18 11:47:16.693935 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:47:16.693935 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:47:16.693935 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:47:16.693935 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:47:16.693935 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpC0QX2SvHowI5-vz58GDwpVMERgGiI-pqt2GQ4o1fdQFbeIrfuLVtcw55IWYTDh91fNo1KVKFcag_YfGjslSHmWVAe8eH9iiMTcKmdOtt4MUEPPWZ9OQcF5wlXB0WJP-XHDUtk0mAsVICaitUhEDH7cqfrNMho4FbOB0yKZgk6M4Ns Oct 18 11:47:16.693935 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:47:16.693935 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:47:16.693935 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:47:16.693935 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:47:16.693935 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:47:16.693935 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:47:16.693935 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: 633afaabbbff47a4a99ebc997e67b01a Oct 18 11:47:16.693935 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:47:16.693935 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:47:16.693935 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:47:16.695593 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/633afaabbbff47a4a99ebc997e67b01a"}]}] Oct 18 11:47:16.695593 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:47:16.695593 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: 633afaabbbff47a4a99ebc997e67b01a Oct 18 11:47:16.695593 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:47:16.695593 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-AttachVolumeNegativeTest-1091652349-project Oct 18 11:47:16.695593 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:47:16.695593 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:47:16.695593 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: 916699a212eb4d8aa945f299ac0d4c96 Oct 18 11:47:16.695593 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-AttachVolumeNegativeTest-1091652349-project Oct 18 11:47:16.695593 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: > Oct 18 11:47:16.695593 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Instance 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 could not be found. Oct 18 11:47:16.695593 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'id': '5ea63cc8-527d-46ea-b6ef-d778dadb8ec5'} Oct 18 11:47:16.696489 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:47:16.696489 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:47:16.696489 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:47:16.696489 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:47:16.696489 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:47:16.696489 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:47:16.696489 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:47:16.696489 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:47:16.696489 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:47:16.696489 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:47:16.696489 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 could not be found. Oct 18 11:47:16.696489 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:47:16.696489 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:47:16.696489 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:47:16.696489 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:47:16.696489 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:47:16.696489 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:47:16.696489 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:47:16.696489 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:47:16.696489 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:47:16.698007 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:47:16.698007 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 11:47:16.698007 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 11:47:16.698007 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 11:47:16.698007 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 11:47:16.698007 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:47:16.698007 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:47:16.698007 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:47:16.698007 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:47:16.698007 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 could not be found. Oct 18 11:47:16.698007 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:47:16.698007 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:47:16.698007 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:47:16.698007 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:47:16.698007 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:47:16.698007 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:47:16.698007 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:47:16.698007 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:47:16.698007 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 could not be found. Oct 18 11:47:16.698007 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:47:16.699454 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-a1473fac-a4f6-410f-b7c9-2131b8e78c56 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Returning 404 to user: Instance 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 could not be found. {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:47:16.699454 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-a1473fac-a4f6-410f-b7c9-2131b8e78c56 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 404 len: 111 microversion: 2.1 time: 0.177001 Oct 18 11:47:16.699454 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 453/880] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Oct 18 11:47:16 2022] DELETE /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:47:16.704155 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-b5d06b7e-9155-4e7b-af17-1167f8249817 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:47:16.704767 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-b5d06b7e-9155-4e7b-af17-1167f8249817 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:47:16.711293 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b5d06b7e-9155-4e7b-af17-1167f8249817 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:16.711775 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b5d06b7e-9155-4e7b-af17-1167f8249817 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:16.712213 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b5d06b7e-9155-4e7b-af17-1167f8249817 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:16.712926 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b5d06b7e-9155-4e7b-af17-1167f8249817 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:16.713380 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b5d06b7e-9155-4e7b-af17-1167f8249817 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:16.713804 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b5d06b7e-9155-4e7b-af17-1167f8249817 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:16.727397 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.wsgi [None req-b5d06b7e-9155-4e7b-af17-1167f8249817 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] HTTP exception thrown: Instance 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 could not be found. Oct 18 11:47:16.728934 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-b5d06b7e-9155-4e7b-af17-1167f8249817 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Request method failure captured: Oct 18 11:47:16.728934 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: request: GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 HTTP/1.1 Oct 18 11:47:16.728934 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept: application/json Oct 18 11:47:16.728934 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept-Encoding: identity Oct 18 11:47:16.728934 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Connection: close Oct 18 11:47:16.728934 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Length: 0 Oct 18 11:47:16.728934 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Type: application/json Oct 18 11:47:16.728934 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Host: 10.222.0.17 Oct 18 11:47:16.728934 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Openstack-System-Scope: None Oct 18 11:47:16.728934 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: User-Agent: python-urllib3/1.26.12 Oct 18 11:47:16.728934 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Auth-Token: gAAAAABjTpC0QX2SvHowI5-vz58GDwpVMERgGiI-pqt2GQ4o1fdQFbeIrfuLVtcw55IWYTDh91fNo1KVKFcag_YfGjslSHmWVAe8eH9iiMTcKmdOtt4MUEPPWZ9OQcF5wlXB0WJP-XHDUtk0mAsVICaitUhEDH7cqfrNMho4FbOB0yKZgk6M4Ns Oct 18 11:47:16.728934 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Id: None Oct 18 11:47:16.728934 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Name: None Oct 18 11:47:16.728934 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Identity-Status: Confirmed Oct 18 11:47:16.728934 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Is-Admin-Project: True Oct 18 11:47:16.728934 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Id: default Oct 18 11:47:16.728934 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Name: Default Oct 18 11:47:16.728934 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Id: 633afaabbbff47a4a99ebc997e67b01a Oct 18 11:47:16.728934 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Name: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:47:16.728934 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Role: reader,member Oct 18 11:47:16.728934 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Roles: reader,member Oct 18 11:47:16.730513 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/633afaabbbff47a4a99ebc997e67b01a"}]}] Oct 18 11:47:16.730513 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:47:16.730513 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Id: 633afaabbbff47a4a99ebc997e67b01a Oct 18 11:47:16.730513 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:47:16.730513 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User: tempest-AttachVolumeNegativeTest-1091652349-project Oct 18 11:47:16.730513 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Id: default Oct 18 11:47:16.730513 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Name: Default Oct 18 11:47:16.730513 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Id: 916699a212eb4d8aa945f299ac0d4c96 Oct 18 11:47:16.730513 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Name: tempest-AttachVolumeNegativeTest-1091652349-project Oct 18 11:47:16.730513 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: method: > Oct 18 11:47:16.730513 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: exception: Instance 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 could not be found. Oct 18 11:47:16.730513 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: action_args: {'id': '5ea63cc8-527d-46ea-b6ef-d778dadb8ec5'} Oct 18 11:47:16.731430 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:47:16.731430 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:47:16.731430 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:47:16.731430 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:47:16.731430 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:47:16.731430 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:47:16.731430 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:47:16.731430 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:47:16.731430 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:47:16.731430 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:47:16.731430 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 could not be found. Oct 18 11:47:16.731430 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:47:16.731430 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:47:16.731430 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:47:16.731430 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:47:16.731430 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:47:16.731430 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:47:16.731430 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:47:16.731430 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:47:16.731430 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:47:16.732946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:47:16.732946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 11:47:16.732946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 11:47:16.732946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:47:16.732946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:47:16.732946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:47:16.732946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:47:16.732946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 could not be found. Oct 18 11:47:16.732946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:47:16.732946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:47:16.732946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:47:16.732946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:47:16.732946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:47:16.732946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:47:16.732946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:47:16.732946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:47:16.732946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 could not be found. Oct 18 11:47:16.732946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:47:16.734282 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-b5d06b7e-9155-4e7b-af17-1167f8249817 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Returning 404 to user: Instance 5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 could not be found. {{(pid=125486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:47:16.734282 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-b5d06b7e-9155-4e7b-af17-1167f8249817 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5" status: 404 len: 111 microversion: 2.1 time: 0.030219 Oct 18 11:47:16.734282 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 428/881] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:47:16 2022] GET /compute/v2.1/servers/5ea63cc8-527d-46ea-b6ef-d778dadb8ec5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 11:47:17.869505 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-739b880d-714e-4206-a7c7-1e70323f36c7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:47:17.869992 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-739b880d-714e-4206-a7c7-1e70323f36c7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:47:17.876155 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-739b880d-714e-4206-a7c7-1e70323f36c7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:17.876631 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-739b880d-714e-4206-a7c7-1e70323f36c7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:17.877090 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-739b880d-714e-4206-a7c7-1e70323f36c7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:17.877768 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-739b880d-714e-4206-a7c7-1e70323f36c7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:17.878210 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-739b880d-714e-4206-a7c7-1e70323f36c7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:17.878620 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-739b880d-714e-4206-a7c7-1e70323f36c7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:17.891567 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.wsgi [None req-739b880d-714e-4206-a7c7-1e70323f36c7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] HTTP exception thrown: Instance b3ed125b-4ca6-484d-9da6-d6e46fba2a13 could not be found. Oct 18 11:47:17.893131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-739b880d-714e-4206-a7c7-1e70323f36c7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Request method failure captured: Oct 18 11:47:17.893131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: DELETE /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13 HTTP/1.1 Oct 18 11:47:17.893131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:47:17.893131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:47:17.893131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:47:17.893131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 0 Oct 18 11:47:17.893131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:47:17.893131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:47:17.893131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:47:17.893131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:47:17.893131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpC0QX2SvHowI5-vz58GDwpVMERgGiI-pqt2GQ4o1fdQFbeIrfuLVtcw55IWYTDh91fNo1KVKFcag_YfGjslSHmWVAe8eH9iiMTcKmdOtt4MUEPPWZ9OQcF5wlXB0WJP-XHDUtk0mAsVICaitUhEDH7cqfrNMho4FbOB0yKZgk6M4Ns Oct 18 11:47:17.893131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:47:17.893131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:47:17.893131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:47:17.893131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:47:17.893131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:47:17.893131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:47:17.893131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: 633afaabbbff47a4a99ebc997e67b01a Oct 18 11:47:17.893131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:47:17.893131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:47:17.893131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:47:17.894644 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/633afaabbbff47a4a99ebc997e67b01a"}]}] Oct 18 11:47:17.894644 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:47:17.894644 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: 633afaabbbff47a4a99ebc997e67b01a Oct 18 11:47:17.894644 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:47:17.894644 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-AttachVolumeNegativeTest-1091652349-project Oct 18 11:47:17.894644 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:47:17.894644 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:47:17.894644 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: 916699a212eb4d8aa945f299ac0d4c96 Oct 18 11:47:17.894644 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-AttachVolumeNegativeTest-1091652349-project Oct 18 11:47:17.894644 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: > Oct 18 11:47:17.894644 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Instance b3ed125b-4ca6-484d-9da6-d6e46fba2a13 could not be found. Oct 18 11:47:17.894644 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'id': 'b3ed125b-4ca6-484d-9da6-d6e46fba2a13'} Oct 18 11:47:17.895491 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:47:17.895491 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:47:17.895491 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:47:17.895491 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:47:17.895491 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:47:17.895491 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:47:17.895491 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:47:17.895491 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:47:17.895491 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:47:17.895491 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:47:17.895491 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3ed125b-4ca6-484d-9da6-d6e46fba2a13 could not be found. Oct 18 11:47:17.895491 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:47:17.895491 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:47:17.895491 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:47:17.895491 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:47:17.895491 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:47:17.895491 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:47:17.895491 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:47:17.895491 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:47:17.895491 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:47:17.896996 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:47:17.896996 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 11:47:17.896996 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 11:47:17.896996 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 11:47:17.896996 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 11:47:17.896996 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:47:17.896996 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:47:17.896996 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:47:17.896996 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:47:17.896996 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3ed125b-4ca6-484d-9da6-d6e46fba2a13 could not be found. Oct 18 11:47:17.896996 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:47:17.896996 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:47:17.896996 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:47:17.896996 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:47:17.896996 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:47:17.896996 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:47:17.896996 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:47:17.896996 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:47:17.896996 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3ed125b-4ca6-484d-9da6-d6e46fba2a13 could not be found. Oct 18 11:47:17.896996 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:47:17.898724 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-739b880d-714e-4206-a7c7-1e70323f36c7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Returning 404 to user: Instance b3ed125b-4ca6-484d-9da6-d6e46fba2a13 could not be found. {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:47:17.898724 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-739b880d-714e-4206-a7c7-1e70323f36c7 tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13" status: 404 len: 111 microversion: 2.1 time: 0.028796 Oct 18 11:47:17.898724 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 454/882] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Oct 18 11:47:17 2022] DELETE /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:47:17.903607 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-83ecf2c3-e569-4fa1-9cfe-71912aa49cbc tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:47:17.904303 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-83ecf2c3-e569-4fa1-9cfe-71912aa49cbc tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] [instance: b3ed125b-4ca6-484d-9da6-d6e46fba2a13] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:47:17.911361 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-83ecf2c3-e569-4fa1-9cfe-71912aa49cbc tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:17.911921 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-83ecf2c3-e569-4fa1-9cfe-71912aa49cbc tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:17.912427 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-83ecf2c3-e569-4fa1-9cfe-71912aa49cbc tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:17.913236 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-83ecf2c3-e569-4fa1-9cfe-71912aa49cbc tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:17.913749 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-83ecf2c3-e569-4fa1-9cfe-71912aa49cbc tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:17.914239 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-83ecf2c3-e569-4fa1-9cfe-71912aa49cbc tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:17.928474 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.wsgi [None req-83ecf2c3-e569-4fa1-9cfe-71912aa49cbc tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] HTTP exception thrown: Instance b3ed125b-4ca6-484d-9da6-d6e46fba2a13 could not be found. Oct 18 11:47:17.930052 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-83ecf2c3-e569-4fa1-9cfe-71912aa49cbc tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Request method failure captured: Oct 18 11:47:17.930052 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: request: GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13 HTTP/1.1 Oct 18 11:47:17.930052 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept: application/json Oct 18 11:47:17.930052 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept-Encoding: identity Oct 18 11:47:17.930052 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Connection: close Oct 18 11:47:17.930052 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Length: 0 Oct 18 11:47:17.930052 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Type: application/json Oct 18 11:47:17.930052 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Host: 10.222.0.17 Oct 18 11:47:17.930052 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Openstack-System-Scope: None Oct 18 11:47:17.930052 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: User-Agent: python-urllib3/1.26.12 Oct 18 11:47:17.930052 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Auth-Token: gAAAAABjTpC0QX2SvHowI5-vz58GDwpVMERgGiI-pqt2GQ4o1fdQFbeIrfuLVtcw55IWYTDh91fNo1KVKFcag_YfGjslSHmWVAe8eH9iiMTcKmdOtt4MUEPPWZ9OQcF5wlXB0WJP-XHDUtk0mAsVICaitUhEDH7cqfrNMho4FbOB0yKZgk6M4Ns Oct 18 11:47:17.930052 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Id: None Oct 18 11:47:17.930052 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Name: None Oct 18 11:47:17.930052 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Identity-Status: Confirmed Oct 18 11:47:17.930052 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Is-Admin-Project: True Oct 18 11:47:17.930052 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Id: default Oct 18 11:47:17.930052 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Name: Default Oct 18 11:47:17.930052 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Id: 633afaabbbff47a4a99ebc997e67b01a Oct 18 11:47:17.930052 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Name: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:47:17.930052 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Role: reader,member Oct 18 11:47:17.930052 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Roles: reader,member Oct 18 11:47:17.931682 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/633afaabbbff47a4a99ebc997e67b01a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/633afaabbbff47a4a99ebc997e67b01a"}]}] Oct 18 11:47:17.931682 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:47:17.931682 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Id: 633afaabbbff47a4a99ebc997e67b01a Oct 18 11:47:17.931682 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1091652349 Oct 18 11:47:17.931682 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User: tempest-AttachVolumeNegativeTest-1091652349-project Oct 18 11:47:17.931682 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Id: default Oct 18 11:47:17.931682 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Name: Default Oct 18 11:47:17.931682 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Id: 916699a212eb4d8aa945f299ac0d4c96 Oct 18 11:47:17.931682 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Name: tempest-AttachVolumeNegativeTest-1091652349-project Oct 18 11:47:17.931682 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: method: > Oct 18 11:47:17.931682 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: exception: Instance b3ed125b-4ca6-484d-9da6-d6e46fba2a13 could not be found. Oct 18 11:47:17.931682 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: action_args: {'id': 'b3ed125b-4ca6-484d-9da6-d6e46fba2a13'} Oct 18 11:47:17.932565 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:47:17.932565 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:47:17.932565 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:47:17.932565 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:47:17.932565 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:47:17.932565 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:47:17.932565 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:47:17.932565 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:47:17.932565 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:47:17.932565 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:47:17.932565 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3ed125b-4ca6-484d-9da6-d6e46fba2a13 could not be found. Oct 18 11:47:17.932565 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:47:17.932565 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:47:17.932565 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:47:17.932565 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:47:17.932565 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:47:17.932565 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:47:17.932565 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:47:17.932565 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:47:17.932565 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:47:17.934017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:47:17.934017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 11:47:17.934017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 11:47:17.934017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:47:17.934017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:47:17.934017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:47:17.934017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:47:17.934017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3ed125b-4ca6-484d-9da6-d6e46fba2a13 could not be found. Oct 18 11:47:17.934017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:47:17.934017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:47:17.934017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:47:17.934017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:47:17.934017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:47:17.934017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:47:17.934017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:47:17.934017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:47:17.934017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3ed125b-4ca6-484d-9da6-d6e46fba2a13 could not be found. Oct 18 11:47:17.934017 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:47:17.935278 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-83ecf2c3-e569-4fa1-9cfe-71912aa49cbc tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] Returning 404 to user: Instance b3ed125b-4ca6-484d-9da6-d6e46fba2a13 could not be found. {{(pid=125486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:47:17.935278 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-83ecf2c3-e569-4fa1-9cfe-71912aa49cbc tempest-AttachVolumeNegativeTest-1091652349 tempest-AttachVolumeNegativeTest-1091652349-project] 10.222.0.17 "GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13" status: 404 len: 111 microversion: 2.1 time: 0.031871 Oct 18 11:47:17.935278 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 429/883] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:47:17 2022] GET /compute/v2.1/servers/b3ed125b-4ca6-484d-9da6-d6e46fba2a13 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:47:59.783555 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-6d84ef73-0802-465c-b2d7-75048aa48cdd tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:47:59.784232 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-6d84ef73-0802-465c-b2d7-75048aa48cdd tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:47:59.787039 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-3d0d1ddf-d38c-4134-934e-95c735281db3 req-34e87542-614a-43ce-be32-d382e48bea74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29b0847b-6a68-4b35-91d4-1ce725985f01", "tag": "ffd48d58-8fbc-42a2-a002-1687b4c71e8e"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:47:59.787495 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:47:59.788133 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:47:59.794188 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:47:59.794827 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=1 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:47:59.801283 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-3d0d1ddf-d38c-4134-934e-95c735281db3 req-34e87542-614a-43ce-be32-d382e48bea74 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:59.801873 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-3d0d1ddf-d38c-4134-934e-95c735281db3 req-34e87542-614a-43ce-be32-d382e48bea74 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:59.802247 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-3d0d1ddf-d38c-4134-934e-95c735281db3 req-34e87542-614a-43ce-be32-d382e48bea74 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:59.803413 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6d84ef73-0802-465c-b2d7-75048aa48cdd tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:59.803905 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6d84ef73-0802-465c-b2d7-75048aa48cdd tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:59.804409 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6d84ef73-0802-465c-b2d7-75048aa48cdd tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:59.805123 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6d84ef73-0802-465c-b2d7-75048aa48cdd tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:59.805580 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6d84ef73-0802-465c-b2d7-75048aa48cdd tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:59.805942 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6d84ef73-0802-465c-b2d7-75048aa48cdd tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:59.816281 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-3d0d1ddf-d38c-4134-934e-95c735281db3 req-34e87542-614a-43ce-be32-d382e48bea74 service nova] Creating event network-changed:ffd48d58-8fbc-42a2-a002-1687b4c71e8e for instance 29b0847b-6a68-4b35-91d4-1ce725985f01 on hv-cinder-81558 Oct 18 11:47:59.821851 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-3d0d1ddf-d38c-4134-934e-95c735281db3 req-34e87542-614a-43ce-be32-d382e48bea74 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039028 Oct 18 11:47:59.822571 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 430/884] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:47:59.852081 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-6d84ef73-0802-465c-b2d7-75048aa48cdd tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Going to try to terminate instance {{(pid=125485) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 11:47:59.953331 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-6d84ef73-0802-465c-b2d7-75048aa48cdd tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "DELETE /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 204 len: 0 microversion: 2.1 time: 0.172976 Oct 18 11:47:59.954103 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 455/885] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Oct 18 11:47:59 2022] DELETE /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 11:47:59.963587 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-0de19141-e04f-4d46-82f7-1d43d4e996d8 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:47:59.964438 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-0de19141-e04f-4d46-82f7-1d43d4e996d8 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:47:59.970699 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0de19141-e04f-4d46-82f7-1d43d4e996d8 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:59.971287 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0de19141-e04f-4d46-82f7-1d43d4e996d8 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:59.972626 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0de19141-e04f-4d46-82f7-1d43d4e996d8 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:47:59.974256 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0de19141-e04f-4d46-82f7-1d43d4e996d8 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:47:59.975063 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0de19141-e04f-4d46-82f7-1d43d4e996d8 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:47:59.975641 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0de19141-e04f-4d46-82f7-1d43d4e996d8 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:00.111775 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-0de19141-e04f-4d46-82f7-1d43d4e996d8 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:48:00.119572 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-0de19141-e04f-4d46-82f7-1d43d4e996d8 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1569 microversion: 2.1 time: 0.160532 Oct 18 11:48:00.120217 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 431/886] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:47:59 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:48:00.750674 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-c5e1a501-a574-4423-95e3-bebcbed2b3e1 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:48:00.753325 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-c5e1a501-a574-4423-95e3-bebcbed2b3e1 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:48:00.760050 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c5e1a501-a574-4423-95e3-bebcbed2b3e1 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:00.760770 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c5e1a501-a574-4423-95e3-bebcbed2b3e1 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:00.761457 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c5e1a501-a574-4423-95e3-bebcbed2b3e1 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:00.762240 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c5e1a501-a574-4423-95e3-bebcbed2b3e1 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:00.762837 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c5e1a501-a574-4423-95e3-bebcbed2b3e1 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:00.763329 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-c5e1a501-a574-4423-95e3-bebcbed2b3e1 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:00.805296 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-c5e1a501-a574-4423-95e3-bebcbed2b3e1 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.059159 Oct 18 11:48:00.806797 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 456/887] 10.222.0.17 () {60 vars in 1343 bytes} [Tue Oct 18 11:48:00 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:48:00.884827 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-b2c2b690-c1a4-4bce-951e-2c08a04c3da8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:48:00.885347 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-b2c2b690-c1a4-4bce-951e-2c08a04c3da8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:48:00.892267 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b2c2b690-c1a4-4bce-951e-2c08a04c3da8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:00.892754 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b2c2b690-c1a4-4bce-951e-2c08a04c3da8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:00.893210 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b2c2b690-c1a4-4bce-951e-2c08a04c3da8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:00.894438 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b2c2b690-c1a4-4bce-951e-2c08a04c3da8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:00.894895 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b2c2b690-c1a4-4bce-951e-2c08a04c3da8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:00.895309 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-b2c2b690-c1a4-4bce-951e-2c08a04c3da8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:00.929528 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-b2c2b690-c1a4-4bce-951e-2c08a04c3da8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Going to try to terminate instance {{(pid=125486) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 11:48:01.017264 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-b2c2b690-c1a4-4bce-951e-2c08a04c3da8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 204 len: 0 microversion: 2.20 time: 0.135904 Oct 18 11:48:01.017769 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 432/888] 10.222.0.17 () {60 vars in 1280 bytes} [Tue Oct 18 11:48:00 2022] DELETE /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 11:48:01.026138 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ab013417-0fee-4b43-a417-1e99e990c3b8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:48:01.026742 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-ab013417-0fee-4b43-a417-1e99e990c3b8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:48:01.032754 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ab013417-0fee-4b43-a417-1e99e990c3b8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:01.033471 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ab013417-0fee-4b43-a417-1e99e990c3b8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:01.033905 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ab013417-0fee-4b43-a417-1e99e990c3b8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:01.035122 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ab013417-0fee-4b43-a417-1e99e990c3b8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:01.035574 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ab013417-0fee-4b43-a417-1e99e990c3b8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:01.035995 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ab013417-0fee-4b43-a417-1e99e990c3b8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:01.145599 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-96c4c22d-cfa0-47bb-bdd3-245124511459 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:48:01.146672 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-96c4c22d-cfa0-47bb-bdd3-245124511459 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:48:01.152911 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-96c4c22d-cfa0-47bb-bdd3-245124511459 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:01.153644 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-96c4c22d-cfa0-47bb-bdd3-245124511459 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:01.154070 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-96c4c22d-cfa0-47bb-bdd3-245124511459 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:01.154760 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-96c4c22d-cfa0-47bb-bdd3-245124511459 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:01.155209 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-96c4c22d-cfa0-47bb-bdd3-245124511459 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:01.155625 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-96c4c22d-cfa0-47bb-bdd3-245124511459 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:01.169988 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-ab013417-0fee-4b43-a417-1e99e990c3b8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:48:01.199167 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-ab013417-0fee-4b43-a417-1e99e990c3b8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:48:01.200694 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-ab013417-0fee-4b43-a417-1e99e990c3b8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:48:01.202181 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-ab013417-0fee-4b43-a417-1e99e990c3b8 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1721 microversion: 2.20 time: 0.180026 Oct 18 11:48:01.202750 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 457/889] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:48:01 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:48:01.339037 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-96c4c22d-cfa0-47bb-bdd3-245124511459 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:48:01.347452 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-96c4c22d-cfa0-47bb-bdd3-245124511459 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1569 microversion: 2.1 time: 0.206278 Oct 18 11:48:01.348250 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 433/890] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:48:01 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1569 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:48:02.228083 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-6086279e-5462-4ba8-8180-47db37e705a0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:48:02.228689 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-6086279e-5462-4ba8-8180-47db37e705a0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:48:02.234974 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6086279e-5462-4ba8-8180-47db37e705a0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:02.235462 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6086279e-5462-4ba8-8180-47db37e705a0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:02.235890 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6086279e-5462-4ba8-8180-47db37e705a0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:02.236588 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6086279e-5462-4ba8-8180-47db37e705a0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:02.237063 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6086279e-5462-4ba8-8180-47db37e705a0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:02.237484 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6086279e-5462-4ba8-8180-47db37e705a0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:02.371250 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-2c586cfb-ed78-4bf3-8b05-4a81efd7ad6e tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:48:02.372047 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-2c586cfb-ed78-4bf3-8b05-4a81efd7ad6e tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:48:02.379241 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2c586cfb-ed78-4bf3-8b05-4a81efd7ad6e tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:02.379809 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2c586cfb-ed78-4bf3-8b05-4a81efd7ad6e tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:02.380460 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2c586cfb-ed78-4bf3-8b05-4a81efd7ad6e tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:02.381407 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2c586cfb-ed78-4bf3-8b05-4a81efd7ad6e tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:02.384721 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-6086279e-5462-4ba8-8180-47db37e705a0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:48:02.388467 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2c586cfb-ed78-4bf3-8b05-4a81efd7ad6e tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:02.388929 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2c586cfb-ed78-4bf3-8b05-4a81efd7ad6e tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:02.395292 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-6086279e-5462-4ba8-8180-47db37e705a0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:48:02.396944 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-6086279e-5462-4ba8-8180-47db37e705a0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:48:02.398252 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-6086279e-5462-4ba8-8180-47db37e705a0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1721 microversion: 2.20 time: 0.174175 Oct 18 11:48:02.398885 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 458/891] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:48:02 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:48:02.600750 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-2c586cfb-ed78-4bf3-8b05-4a81efd7ad6e tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:48:02.612532 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-2c586cfb-ed78-4bf3-8b05-4a81efd7ad6e tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1569 microversion: 2.1 time: 0.245302 Oct 18 11:48:02.624862 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 434/892] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:48:02 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1569 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:48:03.430583 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-044947cc-608e-4bd1-bb21-41ff151df702 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:48:03.432615 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-044947cc-608e-4bd1-bb21-41ff151df702 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:48:03.444636 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-044947cc-608e-4bd1-bb21-41ff151df702 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:03.445569 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-044947cc-608e-4bd1-bb21-41ff151df702 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:03.447447 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-044947cc-608e-4bd1-bb21-41ff151df702 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:03.448455 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-044947cc-608e-4bd1-bb21-41ff151df702 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:03.449215 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-044947cc-608e-4bd1-bb21-41ff151df702 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:03.450560 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-044947cc-608e-4bd1-bb21-41ff151df702 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:03.454996 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-e12c4cad-9d3b-4db9-8dd7-6fc9b6b9b8a7 req-98b18b58-21af-4573-9ac6-ab8d723bd5a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29b0847b-6a68-4b35-91d4-1ce725985f01", "name": "network-vif-deleted", "tag": "ffd48d58-8fbc-42a2-a002-1687b4c71e8e"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:48:03.474370 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-e12c4cad-9d3b-4db9-8dd7-6fc9b6b9b8a7 req-98b18b58-21af-4573-9ac6-ab8d723bd5a2 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:03.474851 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-e12c4cad-9d3b-4db9-8dd7-6fc9b6b9b8a7 req-98b18b58-21af-4573-9ac6-ab8d723bd5a2 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:03.475280 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-e12c4cad-9d3b-4db9-8dd7-6fc9b6b9b8a7 req-98b18b58-21af-4573-9ac6-ab8d723bd5a2 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:03.498166 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-e12c4cad-9d3b-4db9-8dd7-6fc9b6b9b8a7 req-98b18b58-21af-4573-9ac6-ab8d723bd5a2 service nova] Creating event network-vif-deleted:ffd48d58-8fbc-42a2-a002-1687b4c71e8e for instance 29b0847b-6a68-4b35-91d4-1ce725985f01 on hv-cinder-81558 Oct 18 11:48:03.505397 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-e12c4cad-9d3b-4db9-8dd7-6fc9b6b9b8a7 req-98b18b58-21af-4573-9ac6-ab8d723bd5a2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054179 Oct 18 11:48:03.513210 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 435/893] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:48:03.632039 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-044947cc-608e-4bd1-bb21-41ff151df702 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:48:03.636336 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-02e13c9b-b411-4037-a9d5-ed5d45f5d093 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:48:03.637000 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-02e13c9b-b411-4037-a9d5-ed5d45f5d093 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:48:03.641297 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-044947cc-608e-4bd1-bb21-41ff151df702 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:48:03.643043 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-044947cc-608e-4bd1-bb21-41ff151df702 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:48:03.643207 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-02e13c9b-b411-4037-a9d5-ed5d45f5d093 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:03.643636 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-02e13c9b-b411-4037-a9d5-ed5d45f5d093 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:03.644079 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-02e13c9b-b411-4037-a9d5-ed5d45f5d093 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:03.644571 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-044947cc-608e-4bd1-bb21-41ff151df702 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1721 microversion: 2.20 time: 0.222857 Oct 18 11:48:03.644768 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-02e13c9b-b411-4037-a9d5-ed5d45f5d093 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:03.645161 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 459/894] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:48:03 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:48:03.645606 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-02e13c9b-b411-4037-a9d5-ed5d45f5d093 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:03.646030 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-02e13c9b-b411-4037-a9d5-ed5d45f5d093 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:03.734703 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-02e13c9b-b411-4037-a9d5-ed5d45f5d093 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76d70b021f44d1391653477c65f95af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d789b867f24711a6c1b5589a573560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:48:03.743675 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-02e13c9b-b411-4037-a9d5-ed5d45f5d093 tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 200 len: 1383 microversion: 2.1 time: 0.111729 Oct 18 11:48:03.760725 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 436/895] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:48:03 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 1383 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:48:04.245382 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-dfbaf121-49e0-4973-9218-f16f5cf7bd0b req-7de59082-c8e0-47c3-b946-acf6ed64e95a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb2ccf2c-f9af-4953-90e6-88ab81961afe", "name": "network-vif-deleted", "tag": "f0fce60c-3686-40ed-8866-f0bdb6333f0a"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:48:04.255700 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-dfbaf121-49e0-4973-9218-f16f5cf7bd0b req-7de59082-c8e0-47c3-b946-acf6ed64e95a service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:04.256250 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-dfbaf121-49e0-4973-9218-f16f5cf7bd0b req-7de59082-c8e0-47c3-b946-acf6ed64e95a service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:04.256680 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-dfbaf121-49e0-4973-9218-f16f5cf7bd0b req-7de59082-c8e0-47c3-b946-acf6ed64e95a service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:04.269739 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-dfbaf121-49e0-4973-9218-f16f5cf7bd0b req-7de59082-c8e0-47c3-b946-acf6ed64e95a service nova] Creating event network-vif-deleted:f0fce60c-3686-40ed-8866-f0bdb6333f0a for instance bb2ccf2c-f9af-4953-90e6-88ab81961afe on hv-cinder-81558 Oct 18 11:48:04.278968 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-dfbaf121-49e0-4973-9218-f16f5cf7bd0b req-7de59082-c8e0-47c3-b946-acf6ed64e95a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037366 Oct 18 11:48:04.279627 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 460/896] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:48:04.676519 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-029e243c-8ea3-4c49-856c-68900d763a42 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:48:04.677139 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-029e243c-8ea3-4c49-856c-68900d763a42 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:48:04.683679 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-029e243c-8ea3-4c49-856c-68900d763a42 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:04.684242 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-029e243c-8ea3-4c49-856c-68900d763a42 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:04.684739 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-029e243c-8ea3-4c49-856c-68900d763a42 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:04.685520 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-029e243c-8ea3-4c49-856c-68900d763a42 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:04.686048 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-029e243c-8ea3-4c49-856c-68900d763a42 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:04.686542 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-029e243c-8ea3-4c49-856c-68900d763a42 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:04.720739 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-029e243c-8ea3-4c49-856c-68900d763a42 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:04.721399 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-029e243c-8ea3-4c49-856c-68900d763a42 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:04.722410 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-029e243c-8ea3-4c49-856c-68900d763a42 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:04.722865 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.objects.instance [None req-029e243c-8ea3-4c49-856c-68900d763a42 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lazy-loading 'fault' on Instance uuid bb2ccf2c-f9af-4953-90e6-88ab81961afe {{(pid=125486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:48:04.767553 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-9dc90d6e-d7cc-40bc-90a5-28f5617e343d tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:48:04.768250 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-9dc90d6e-d7cc-40bc-90a5-28f5617e343d tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] [instance: 29b0847b-6a68-4b35-91d4-1ce725985f01] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:48:04.774965 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9dc90d6e-d7cc-40bc-90a5-28f5617e343d tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:04.775455 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9dc90d6e-d7cc-40bc-90a5-28f5617e343d tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:04.775977 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9dc90d6e-d7cc-40bc-90a5-28f5617e343d tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:04.779983 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-029e243c-8ea3-4c49-856c-68900d763a42 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:48:04.781085 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9dc90d6e-d7cc-40bc-90a5-28f5617e343d tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:04.782063 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9dc90d6e-d7cc-40bc-90a5-28f5617e343d tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:04.783006 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9dc90d6e-d7cc-40bc-90a5-28f5617e343d tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:04.789856 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-029e243c-8ea3-4c49-856c-68900d763a42 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:48:04.791626 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-029e243c-8ea3-4c49-856c-68900d763a42 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d748ebce2742058757304095d1a641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84cfe68e5db4b2dba60443b48d23097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:48:04.793101 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-029e243c-8ea3-4c49-856c-68900d763a42 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 200 len: 1369 microversion: 2.20 time: 0.122273 Oct 18 11:48:04.812308 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 437/897] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:48:04 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 1369 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 11:48:04.818076 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.wsgi [None req-9dc90d6e-d7cc-40bc-90a5-28f5617e343d tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] HTTP exception thrown: Instance 29b0847b-6a68-4b35-91d4-1ce725985f01 could not be found. Oct 18 11:48:04.820203 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-9dc90d6e-d7cc-40bc-90a5-28f5617e343d tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Request method failure captured: Oct 18 11:48:04.820203 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 HTTP/1.1 Oct 18 11:48:04.820203 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:48:04.820203 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:48:04.820203 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:48:04.820203 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 0 Oct 18 11:48:04.820203 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:48:04.820203 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:48:04.820203 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:48:04.820203 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:48:04.820203 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpEknIB39ZK2NiyK-ElIgFrGvZnhmWxEDkdE169WshdRRi1Ms2Q8FQvRNWa_tV_Qdqfl-U8X_1SCXU3N9xUFMuXUlS7kc0Ut5wDoJSDr6Gg4lyyHG0kK9NcBFaAKf1bpVjtI0H-8ulmOZUA6Li6QiuquHv_MQMVJPaVJgzABVrAjlBw Oct 18 11:48:04.820203 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:48:04.820203 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:48:04.820203 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:48:04.820203 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:48:04.820203 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:48:04.820203 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:48:04.820203 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: 34d789b867f24711a6c1b5589a573560 Oct 18 11:48:04.820203 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-TestShelveInstance-552830728 Oct 18 11:48:04.820203 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:48:04.820203 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:48:04.822082 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/34d789b867f24711a6c1b5589a573560"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_34d789b867f24711a6c1b5589a573560"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/34d789b867f24711a6c1b5589a573560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/34d789b867f24711a6c1b5589a573560"}]}] Oct 18 11:48:04.822082 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-TestShelveInstance-552830728 Oct 18 11:48:04.822082 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: 34d789b867f24711a6c1b5589a573560 Oct 18 11:48:04.822082 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-TestShelveInstance-552830728 Oct 18 11:48:04.822082 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-TestShelveInstance-552830728-project Oct 18 11:48:04.822082 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:48:04.822082 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:48:04.822082 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: f76d70b021f44d1391653477c65f95af Oct 18 11:48:04.822082 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-TestShelveInstance-552830728-project Oct 18 11:48:04.822082 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: > Oct 18 11:48:04.822082 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Instance 29b0847b-6a68-4b35-91d4-1ce725985f01 could not be found. Oct 18 11:48:04.822082 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'id': '29b0847b-6a68-4b35-91d4-1ce725985f01'} Oct 18 11:48:04.823419 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:48:04.823419 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:48:04.823419 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:48:04.823419 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:48:04.823419 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:48:04.823419 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:48:04.823419 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:48:04.823419 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:48:04.823419 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:48:04.823419 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:48:04.823419 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29b0847b-6a68-4b35-91d4-1ce725985f01 could not be found. Oct 18 11:48:04.823419 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:48:04.823419 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:48:04.823419 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:48:04.823419 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:48:04.823419 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:48:04.823419 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:48:04.823419 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:48:04.823419 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:48:04.823419 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:48:04.825588 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:48:04.825588 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 11:48:04.825588 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 11:48:04.825588 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:48:04.825588 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:48:04.825588 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:48:04.825588 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:48:04.825588 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29b0847b-6a68-4b35-91d4-1ce725985f01 could not be found. Oct 18 11:48:04.825588 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:48:04.825588 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:48:04.825588 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:48:04.825588 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:48:04.825588 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:48:04.825588 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:48:04.825588 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:48:04.825588 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:48:04.825588 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29b0847b-6a68-4b35-91d4-1ce725985f01 could not be found. Oct 18 11:48:04.825588 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:48:04.827347 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-9dc90d6e-d7cc-40bc-90a5-28f5617e343d tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Returning 404 to user: Instance 29b0847b-6a68-4b35-91d4-1ce725985f01 could not be found. {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:48:04.827347 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-9dc90d6e-d7cc-40bc-90a5-28f5617e343d tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01" status: 404 len: 111 microversion: 2.1 time: 0.059116 Oct 18 11:48:04.827347 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 461/898] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:48:04 2022] GET /compute/v2.1/servers/29b0847b-6a68-4b35-91d4-1ce725985f01 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 11:48:05.030736 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-cc740866-fa15-4b68-9e8b-4e05876107db tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] Calling method '.version_select at 0x7f4bdbfab0d0>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:48:05.060577 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-cc740866-fa15-4b68-9e8b-4e05876107db tempest-TestShelveInstance-552830728 tempest-TestShelveInstance-552830728-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-910036943" status: 202 len: 0 microversion: 2.1 time: 0.033878 Oct 18 11:48:05.061311 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 438/899] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Oct 18 11:48:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-910036943 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 11:48:05.818170 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-346839e8-03a0-43da-9e47-bb5f8df97249 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:48:05.818807 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-346839e8-03a0-43da-9e47-bb5f8df97249 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:48:05.825271 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-346839e8-03a0-43da-9e47-bb5f8df97249 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:05.825752 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-346839e8-03a0-43da-9e47-bb5f8df97249 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:05.826451 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-346839e8-03a0-43da-9e47-bb5f8df97249 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:05.827288 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-346839e8-03a0-43da-9e47-bb5f8df97249 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:05.827631 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-346839e8-03a0-43da-9e47-bb5f8df97249 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:05.828052 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-346839e8-03a0-43da-9e47-bb5f8df97249 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:05.842175 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.wsgi [None req-346839e8-03a0-43da-9e47-bb5f8df97249 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] HTTP exception thrown: Instance bb2ccf2c-f9af-4953-90e6-88ab81961afe could not be found. Oct 18 11:48:05.843739 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-346839e8-03a0-43da-9e47-bb5f8df97249 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Request method failure captured: Oct 18 11:48:05.843739 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe HTTP/1.1 Oct 18 11:48:05.843739 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:48:05.843739 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:48:05.843739 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:48:05.843739 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 0 Oct 18 11:48:05.843739 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:48:05.843739 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:48:05.843739 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:48:05.843739 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:48:05.843739 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpD-afc9lTwVyWNoeKrcwdibmsDnK1_JwD8xfNCwibUypcKZiq4F7at3MbhFhuB-njWr1w-PsQZwMGvpu9u0JY1lRX6PUymcjGKLuOhPiqjkMgGnuUSCFUA9Mc_ddtpasTB8QaQwwyC6v1sjVOexo45w2k7uG6XZDh0PXxHC7pvCUL0 Oct 18 11:48:05.843739 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:48:05.843739 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:48:05.843739 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:48:05.843739 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:48:05.843739 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Openstack-Nova-Api-Version: 2.20 Oct 18 11:48:05.843739 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:48:05.843739 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:48:05.843739 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: c84cfe68e5db4b2dba60443b48d23097 Oct 18 11:48:05.843739 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1946372457 Oct 18 11:48:05.843739 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:48:05.843739 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:48:05.845483 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c84cfe68e5db4b2dba60443b48d23097"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c84cfe68e5db4b2dba60443b48d23097"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c84cfe68e5db4b2dba60443b48d23097"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c84cfe68e5db4b2dba60443b48d23097"}]}] Oct 18 11:48:05.845483 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1946372457 Oct 18 11:48:05.845483 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: c84cfe68e5db4b2dba60443b48d23097 Oct 18 11:48:05.845483 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1946372457 Oct 18 11:48:05.845483 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-AttachVolumeShelveTestJSON-1946372457-project Oct 18 11:48:05.845483 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:48:05.845483 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:48:05.845483 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: 72d748ebce2742058757304095d1a641 Oct 18 11:48:05.845483 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1946372457-project Oct 18 11:48:05.845483 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: > Oct 18 11:48:05.845483 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Instance bb2ccf2c-f9af-4953-90e6-88ab81961afe could not be found. Oct 18 11:48:05.845483 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'id': 'bb2ccf2c-f9af-4953-90e6-88ab81961afe'} Oct 18 11:48:05.846289 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:48:05.846289 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:48:05.846289 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:48:05.846289 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:48:05.846289 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:48:05.846289 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:48:05.846289 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:48:05.846289 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:48:05.846289 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:48:05.846289 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:48:05.846289 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb2ccf2c-f9af-4953-90e6-88ab81961afe could not be found. Oct 18 11:48:05.846289 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:48:05.846289 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:48:05.846289 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:48:05.846289 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:48:05.846289 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:48:05.846289 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:48:05.846289 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:48:05.846289 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:48:05.846289 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:48:05.848163 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:48:05.848163 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 11:48:05.848163 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 11:48:05.848163 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:48:05.848163 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:48:05.848163 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:48:05.848163 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:48:05.848163 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb2ccf2c-f9af-4953-90e6-88ab81961afe could not be found. Oct 18 11:48:05.848163 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:48:05.848163 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:48:05.848163 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:48:05.848163 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:48:05.848163 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:48:05.848163 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:48:05.848163 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:48:05.848163 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:48:05.848163 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb2ccf2c-f9af-4953-90e6-88ab81961afe could not be found. Oct 18 11:48:05.848163 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:48:05.849316 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-346839e8-03a0-43da-9e47-bb5f8df97249 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Returning 404 to user: Instance bb2ccf2c-f9af-4953-90e6-88ab81961afe could not be found. {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:48:05.849316 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-346839e8-03a0-43da-9e47-bb5f8df97249 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 404 len: 111 microversion: 2.20 time: 0.030954 Oct 18 11:48:05.849316 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 462/900] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:48:05 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 11:48:05.854617 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-2c1f6773-9ff1-4067-9fc3-1748f9cb9d86 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '.version_select at 0x7f4bdbe9a9d0>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:48:05.876808 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-2c1f6773-9ff1-4067-9fc3-1748f9cb9d86 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-581564285" status: 204 len: 0 microversion: 2.20 time: 0.025900 Oct 18 11:48:05.881040 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 439/901] 10.222.0.17 () {60 vars in 1259 bytes} [Tue Oct 18 11:48:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-581564285 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 11:48:08.046109 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ac9d22bf-7b3e-4cc6-b80a-dba366dcac3f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:48:08.047410 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-ac9d22bf-7b3e-4cc6-b80a-dba366dcac3f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:48:08.055263 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ac9d22bf-7b3e-4cc6-b80a-dba366dcac3f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:08.055965 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ac9d22bf-7b3e-4cc6-b80a-dba366dcac3f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:08.056395 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ac9d22bf-7b3e-4cc6-b80a-dba366dcac3f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:08.057140 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ac9d22bf-7b3e-4cc6-b80a-dba366dcac3f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:08.057746 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ac9d22bf-7b3e-4cc6-b80a-dba366dcac3f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:08.058351 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ac9d22bf-7b3e-4cc6-b80a-dba366dcac3f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:08.073854 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.wsgi [None req-ac9d22bf-7b3e-4cc6-b80a-dba366dcac3f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] HTTP exception thrown: Instance bb2ccf2c-f9af-4953-90e6-88ab81961afe could not be found. Oct 18 11:48:08.075566 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ac9d22bf-7b3e-4cc6-b80a-dba366dcac3f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Request method failure captured: Oct 18 11:48:08.075566 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: DELETE /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe HTTP/1.1 Oct 18 11:48:08.075566 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:48:08.075566 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:48:08.075566 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:48:08.075566 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 0 Oct 18 11:48:08.075566 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:48:08.075566 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:48:08.075566 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:48:08.075566 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:48:08.075566 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpD-afc9lTwVyWNoeKrcwdibmsDnK1_JwD8xfNCwibUypcKZiq4F7at3MbhFhuB-njWr1w-PsQZwMGvpu9u0JY1lRX6PUymcjGKLuOhPiqjkMgGnuUSCFUA9Mc_ddtpasTB8QaQwwyC6v1sjVOexo45w2k7uG6XZDh0PXxHC7pvCUL0 Oct 18 11:48:08.075566 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:48:08.075566 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:48:08.075566 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:48:08.075566 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:48:08.075566 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Openstack-Nova-Api-Version: 2.20 Oct 18 11:48:08.075566 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:48:08.075566 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:48:08.075566 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: c84cfe68e5db4b2dba60443b48d23097 Oct 18 11:48:08.075566 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1946372457 Oct 18 11:48:08.075566 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:48:08.075566 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:48:08.077216 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c84cfe68e5db4b2dba60443b48d23097"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c84cfe68e5db4b2dba60443b48d23097"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c84cfe68e5db4b2dba60443b48d23097"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c84cfe68e5db4b2dba60443b48d23097"}]}] Oct 18 11:48:08.077216 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1946372457 Oct 18 11:48:08.077216 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: c84cfe68e5db4b2dba60443b48d23097 Oct 18 11:48:08.077216 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1946372457 Oct 18 11:48:08.077216 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-AttachVolumeShelveTestJSON-1946372457-project Oct 18 11:48:08.077216 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:48:08.077216 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:48:08.077216 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: 72d748ebce2742058757304095d1a641 Oct 18 11:48:08.077216 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1946372457-project Oct 18 11:48:08.077216 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: > Oct 18 11:48:08.077216 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Instance bb2ccf2c-f9af-4953-90e6-88ab81961afe could not be found. Oct 18 11:48:08.077216 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'id': 'bb2ccf2c-f9af-4953-90e6-88ab81961afe'} Oct 18 11:48:08.078299 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:48:08.078299 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:48:08.078299 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:48:08.078299 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:48:08.078299 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:48:08.078299 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:48:08.078299 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:48:08.078299 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:48:08.078299 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:48:08.078299 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:48:08.078299 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb2ccf2c-f9af-4953-90e6-88ab81961afe could not be found. Oct 18 11:48:08.078299 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:48:08.078299 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:48:08.078299 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:48:08.078299 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:48:08.078299 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:48:08.078299 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:48:08.078299 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:48:08.078299 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:48:08.078299 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:48:08.079536 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:48:08.079536 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 11:48:08.079536 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 11:48:08.079536 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 11:48:08.079536 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 11:48:08.079536 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:48:08.079536 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:48:08.079536 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:48:08.079536 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:48:08.079536 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb2ccf2c-f9af-4953-90e6-88ab81961afe could not be found. Oct 18 11:48:08.079536 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:48:08.079536 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:48:08.079536 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:48:08.079536 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:48:08.079536 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:48:08.079536 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:48:08.079536 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:48:08.079536 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:48:08.079536 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb2ccf2c-f9af-4953-90e6-88ab81961afe could not be found. Oct 18 11:48:08.079536 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:48:08.080787 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ac9d22bf-7b3e-4cc6-b80a-dba366dcac3f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Returning 404 to user: Instance bb2ccf2c-f9af-4953-90e6-88ab81961afe could not be found. {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:48:08.080787 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-ac9d22bf-7b3e-4cc6-b80a-dba366dcac3f tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 404 len: 111 microversion: 2.20 time: 0.035160 Oct 18 11:48:08.081707 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 463/902] 10.222.0.17 () {60 vars in 1280 bytes} [Tue Oct 18 11:48:08 2022] DELETE /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 11:48:08.087784 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-cfacc327-062a-41d7-9d75-812272fa2174 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:48:08.088467 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-cfacc327-062a-41d7-9d75-812272fa2174 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: bb2ccf2c-f9af-4953-90e6-88ab81961afe] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:48:08.105574 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cfacc327-062a-41d7-9d75-812272fa2174 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:08.106287 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cfacc327-062a-41d7-9d75-812272fa2174 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:08.106726 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cfacc327-062a-41d7-9d75-812272fa2174 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:08.107450 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cfacc327-062a-41d7-9d75-812272fa2174 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:08.107909 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cfacc327-062a-41d7-9d75-812272fa2174 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:08.108333 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-cfacc327-062a-41d7-9d75-812272fa2174 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:08.155217 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.wsgi [None req-cfacc327-062a-41d7-9d75-812272fa2174 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] HTTP exception thrown: Instance bb2ccf2c-f9af-4953-90e6-88ab81961afe could not be found. Oct 18 11:48:08.157223 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-cfacc327-062a-41d7-9d75-812272fa2174 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Request method failure captured: Oct 18 11:48:08.157223 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: request: GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe HTTP/1.1 Oct 18 11:48:08.157223 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept: application/json Oct 18 11:48:08.157223 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept-Encoding: identity Oct 18 11:48:08.157223 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Connection: close Oct 18 11:48:08.157223 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Length: 0 Oct 18 11:48:08.157223 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Type: application/json Oct 18 11:48:08.157223 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Host: 10.222.0.17 Oct 18 11:48:08.157223 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Openstack-System-Scope: None Oct 18 11:48:08.157223 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: User-Agent: python-urllib3/1.26.12 Oct 18 11:48:08.157223 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Auth-Token: gAAAAABjTpD-afc9lTwVyWNoeKrcwdibmsDnK1_JwD8xfNCwibUypcKZiq4F7at3MbhFhuB-njWr1w-PsQZwMGvpu9u0JY1lRX6PUymcjGKLuOhPiqjkMgGnuUSCFUA9Mc_ddtpasTB8QaQwwyC6v1sjVOexo45w2k7uG6XZDh0PXxHC7pvCUL0 Oct 18 11:48:08.157223 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Id: None Oct 18 11:48:08.157223 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Name: None Oct 18 11:48:08.157223 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Identity-Status: Confirmed Oct 18 11:48:08.157223 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Is-Admin-Project: True Oct 18 11:48:08.157223 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Openstack-Nova-Api-Version: 2.20 Oct 18 11:48:08.157223 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Id: default Oct 18 11:48:08.157223 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Name: Default Oct 18 11:48:08.157223 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Id: c84cfe68e5db4b2dba60443b48d23097 Oct 18 11:48:08.157223 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1946372457 Oct 18 11:48:08.157223 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Role: reader,member Oct 18 11:48:08.157223 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Roles: reader,member Oct 18 11:48:08.158941 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c84cfe68e5db4b2dba60443b48d23097"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c84cfe68e5db4b2dba60443b48d23097"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c84cfe68e5db4b2dba60443b48d23097"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c84cfe68e5db4b2dba60443b48d23097"}]}] Oct 18 11:48:08.158941 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1946372457 Oct 18 11:48:08.158941 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Id: c84cfe68e5db4b2dba60443b48d23097 Oct 18 11:48:08.158941 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1946372457 Oct 18 11:48:08.158941 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User: tempest-AttachVolumeShelveTestJSON-1946372457-project Oct 18 11:48:08.158941 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Id: default Oct 18 11:48:08.158941 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Name: Default Oct 18 11:48:08.158941 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Id: 72d748ebce2742058757304095d1a641 Oct 18 11:48:08.158941 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1946372457-project Oct 18 11:48:08.158941 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: method: > Oct 18 11:48:08.158941 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: exception: Instance bb2ccf2c-f9af-4953-90e6-88ab81961afe could not be found. Oct 18 11:48:08.158941 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: action_args: {'id': 'bb2ccf2c-f9af-4953-90e6-88ab81961afe'} Oct 18 11:48:08.159864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:48:08.159864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:48:08.159864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:48:08.159864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:48:08.159864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:48:08.159864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:48:08.159864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:48:08.159864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:48:08.159864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:48:08.159864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:48:08.159864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb2ccf2c-f9af-4953-90e6-88ab81961afe could not be found. Oct 18 11:48:08.159864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:48:08.159864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:48:08.159864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:48:08.159864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:48:08.159864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:48:08.159864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:48:08.159864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:48:08.159864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:48:08.159864 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:48:08.161911 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:48:08.161911 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 11:48:08.161911 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 11:48:08.161911 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:48:08.161911 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:48:08.161911 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:48:08.161911 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:48:08.161911 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb2ccf2c-f9af-4953-90e6-88ab81961afe could not be found. Oct 18 11:48:08.161911 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:48:08.161911 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:48:08.161911 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:48:08.161911 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:48:08.161911 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:48:08.161911 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:48:08.161911 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:48:08.161911 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:48:08.161911 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb2ccf2c-f9af-4953-90e6-88ab81961afe could not be found. Oct 18 11:48:08.161911 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:48:08.166411 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-cfacc327-062a-41d7-9d75-812272fa2174 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Returning 404 to user: Instance bb2ccf2c-f9af-4953-90e6-88ab81961afe could not be found. {{(pid=125486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:48:08.166411 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-cfacc327-062a-41d7-9d75-812272fa2174 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe" status: 404 len: 111 microversion: 2.20 time: 0.083100 Oct 18 11:48:08.166962 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 440/903] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:48:08 2022] GET /compute/v2.1/servers/bb2ccf2c-f9af-4953-90e6-88ab81961afe => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 11:48:09.352969 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ffd8fa58-e620-47b0-9cc3-47f359b08aa0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:48:09.354035 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-ffd8fa58-e620-47b0-9cc3-47f359b08aa0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:48:09.360455 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ffd8fa58-e620-47b0-9cc3-47f359b08aa0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:09.360971 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ffd8fa58-e620-47b0-9cc3-47f359b08aa0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:09.361403 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ffd8fa58-e620-47b0-9cc3-47f359b08aa0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:09.362377 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ffd8fa58-e620-47b0-9cc3-47f359b08aa0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:09.362830 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ffd8fa58-e620-47b0-9cc3-47f359b08aa0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:09.363250 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ffd8fa58-e620-47b0-9cc3-47f359b08aa0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:09.377039 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.wsgi [None req-ffd8fa58-e620-47b0-9cc3-47f359b08aa0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] HTTP exception thrown: Instance a2b9dfa2-7553-47cd-8274-6a0004bac79d could not be found. Oct 18 11:48:09.378637 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ffd8fa58-e620-47b0-9cc3-47f359b08aa0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Request method failure captured: Oct 18 11:48:09.378637 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: DELETE /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d HTTP/1.1 Oct 18 11:48:09.378637 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:48:09.378637 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:48:09.378637 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:48:09.378637 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 0 Oct 18 11:48:09.378637 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:48:09.378637 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:48:09.378637 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:48:09.378637 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:48:09.378637 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpD-afc9lTwVyWNoeKrcwdibmsDnK1_JwD8xfNCwibUypcKZiq4F7at3MbhFhuB-njWr1w-PsQZwMGvpu9u0JY1lRX6PUymcjGKLuOhPiqjkMgGnuUSCFUA9Mc_ddtpasTB8QaQwwyC6v1sjVOexo45w2k7uG6XZDh0PXxHC7pvCUL0 Oct 18 11:48:09.378637 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:48:09.378637 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:48:09.378637 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:48:09.378637 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:48:09.378637 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Openstack-Nova-Api-Version: 2.20 Oct 18 11:48:09.378637 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:48:09.378637 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:48:09.378637 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: c84cfe68e5db4b2dba60443b48d23097 Oct 18 11:48:09.378637 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1946372457 Oct 18 11:48:09.378637 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:48:09.378637 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:48:09.380407 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c84cfe68e5db4b2dba60443b48d23097"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c84cfe68e5db4b2dba60443b48d23097"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c84cfe68e5db4b2dba60443b48d23097"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c84cfe68e5db4b2dba60443b48d23097"}]}] Oct 18 11:48:09.380407 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1946372457 Oct 18 11:48:09.380407 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: c84cfe68e5db4b2dba60443b48d23097 Oct 18 11:48:09.380407 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1946372457 Oct 18 11:48:09.380407 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-AttachVolumeShelveTestJSON-1946372457-project Oct 18 11:48:09.380407 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:48:09.380407 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:48:09.380407 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: 72d748ebce2742058757304095d1a641 Oct 18 11:48:09.380407 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1946372457-project Oct 18 11:48:09.380407 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: > Oct 18 11:48:09.380407 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Instance a2b9dfa2-7553-47cd-8274-6a0004bac79d could not be found. Oct 18 11:48:09.380407 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'id': 'a2b9dfa2-7553-47cd-8274-6a0004bac79d'} Oct 18 11:48:09.381333 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:48:09.381333 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:48:09.381333 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:48:09.381333 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:48:09.381333 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:48:09.381333 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:48:09.381333 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:48:09.381333 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:48:09.381333 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:48:09.381333 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:48:09.381333 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2b9dfa2-7553-47cd-8274-6a0004bac79d could not be found. Oct 18 11:48:09.381333 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:48:09.381333 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:48:09.381333 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:48:09.381333 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:48:09.381333 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:48:09.381333 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:48:09.381333 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:48:09.381333 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:48:09.381333 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:48:09.382900 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:48:09.382900 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 11:48:09.382900 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 11:48:09.382900 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 11:48:09.382900 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 11:48:09.382900 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:48:09.382900 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:48:09.382900 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:48:09.382900 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:48:09.382900 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2b9dfa2-7553-47cd-8274-6a0004bac79d could not be found. Oct 18 11:48:09.382900 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:48:09.382900 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:48:09.382900 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:48:09.382900 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:48:09.382900 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:48:09.382900 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:48:09.382900 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:48:09.382900 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:48:09.382900 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2b9dfa2-7553-47cd-8274-6a0004bac79d could not be found. Oct 18 11:48:09.382900 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:48:09.385274 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ffd8fa58-e620-47b0-9cc3-47f359b08aa0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Returning 404 to user: Instance a2b9dfa2-7553-47cd-8274-6a0004bac79d could not be found. {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:48:09.386127 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-ffd8fa58-e620-47b0-9cc3-47f359b08aa0 tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 404 len: 111 microversion: 2.20 time: 0.037107 Oct 18 11:48:09.386886 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 464/904] 10.222.0.17 () {60 vars in 1280 bytes} [Tue Oct 18 11:48:09 2022] DELETE /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 18 11:48:09.396024 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-2a124b8f-6825-42ae-bc49-a6b4c542c67e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:48:09.397001 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-2a124b8f-6825-42ae-bc49-a6b4c542c67e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] [instance: a2b9dfa2-7553-47cd-8274-6a0004bac79d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:48:09.416105 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2a124b8f-6825-42ae-bc49-a6b4c542c67e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:09.416597 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2a124b8f-6825-42ae-bc49-a6b4c542c67e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:09.417128 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2a124b8f-6825-42ae-bc49-a6b4c542c67e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:09.417993 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2a124b8f-6825-42ae-bc49-a6b4c542c67e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:48:09.418818 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2a124b8f-6825-42ae-bc49-a6b4c542c67e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:48:09.419199 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-2a124b8f-6825-42ae-bc49-a6b4c542c67e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:48:09.434027 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.wsgi [None req-2a124b8f-6825-42ae-bc49-a6b4c542c67e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] HTTP exception thrown: Instance a2b9dfa2-7553-47cd-8274-6a0004bac79d could not be found. Oct 18 11:48:09.435707 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-2a124b8f-6825-42ae-bc49-a6b4c542c67e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Request method failure captured: Oct 18 11:48:09.435707 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: request: GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d HTTP/1.1 Oct 18 11:48:09.435707 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept: application/json Oct 18 11:48:09.435707 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept-Encoding: identity Oct 18 11:48:09.435707 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Connection: close Oct 18 11:48:09.435707 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Length: 0 Oct 18 11:48:09.435707 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Type: application/json Oct 18 11:48:09.435707 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Host: 10.222.0.17 Oct 18 11:48:09.435707 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Openstack-System-Scope: None Oct 18 11:48:09.435707 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: User-Agent: python-urllib3/1.26.12 Oct 18 11:48:09.435707 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Auth-Token: gAAAAABjTpD-afc9lTwVyWNoeKrcwdibmsDnK1_JwD8xfNCwibUypcKZiq4F7at3MbhFhuB-njWr1w-PsQZwMGvpu9u0JY1lRX6PUymcjGKLuOhPiqjkMgGnuUSCFUA9Mc_ddtpasTB8QaQwwyC6v1sjVOexo45w2k7uG6XZDh0PXxHC7pvCUL0 Oct 18 11:48:09.435707 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Id: None Oct 18 11:48:09.435707 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Name: None Oct 18 11:48:09.435707 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Identity-Status: Confirmed Oct 18 11:48:09.435707 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Is-Admin-Project: True Oct 18 11:48:09.435707 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Openstack-Nova-Api-Version: 2.20 Oct 18 11:48:09.435707 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Id: default Oct 18 11:48:09.435707 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Name: Default Oct 18 11:48:09.435707 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Id: c84cfe68e5db4b2dba60443b48d23097 Oct 18 11:48:09.435707 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1946372457 Oct 18 11:48:09.435707 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Role: reader,member Oct 18 11:48:09.435707 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Roles: reader,member Oct 18 11:48:09.437491 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c84cfe68e5db4b2dba60443b48d23097"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c84cfe68e5db4b2dba60443b48d23097"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c84cfe68e5db4b2dba60443b48d23097"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c84cfe68e5db4b2dba60443b48d23097"}]}] Oct 18 11:48:09.437491 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1946372457 Oct 18 11:48:09.437491 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Id: c84cfe68e5db4b2dba60443b48d23097 Oct 18 11:48:09.437491 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1946372457 Oct 18 11:48:09.437491 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User: tempest-AttachVolumeShelveTestJSON-1946372457-project Oct 18 11:48:09.437491 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Id: default Oct 18 11:48:09.437491 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Name: Default Oct 18 11:48:09.437491 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Id: 72d748ebce2742058757304095d1a641 Oct 18 11:48:09.437491 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1946372457-project Oct 18 11:48:09.437491 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: method: > Oct 18 11:48:09.437491 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: exception: Instance a2b9dfa2-7553-47cd-8274-6a0004bac79d could not be found. Oct 18 11:48:09.437491 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: action_args: {'id': 'a2b9dfa2-7553-47cd-8274-6a0004bac79d'} Oct 18 11:48:09.438310 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:48:09.438310 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:48:09.438310 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:48:09.438310 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:48:09.438310 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:48:09.438310 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:48:09.438310 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:48:09.438310 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:48:09.438310 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:48:09.438310 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:48:09.438310 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2b9dfa2-7553-47cd-8274-6a0004bac79d could not be found. Oct 18 11:48:09.438310 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:48:09.438310 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:48:09.438310 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:48:09.438310 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:48:09.438310 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:48:09.438310 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:48:09.438310 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:48:09.438310 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:48:09.438310 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:48:09.439594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:48:09.439594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 11:48:09.439594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 11:48:09.439594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:48:09.439594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:48:09.439594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:48:09.439594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:48:09.439594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2b9dfa2-7553-47cd-8274-6a0004bac79d could not be found. Oct 18 11:48:09.439594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:48:09.439594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:48:09.439594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:48:09.439594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:48:09.439594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:48:09.439594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:48:09.439594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:48:09.439594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:48:09.439594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2b9dfa2-7553-47cd-8274-6a0004bac79d could not be found. Oct 18 11:48:09.439594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:48:09.440744 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-2a124b8f-6825-42ae-bc49-a6b4c542c67e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] Returning 404 to user: Instance a2b9dfa2-7553-47cd-8274-6a0004bac79d could not be found. {{(pid=125486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:48:09.440744 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-2a124b8f-6825-42ae-bc49-a6b4c542c67e tempest-AttachVolumeShelveTestJSON-1946372457 tempest-AttachVolumeShelveTestJSON-1946372457-project] 10.222.0.17 "GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d" status: 404 len: 111 microversion: 2.20 time: 0.045971 Oct 18 11:48:09.440744 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 441/905] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Oct 18 11:48:09 2022] GET /compute/v2.1/servers/a2b9dfa2-7553-47cd-8274-6a0004bac79d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 11:48:15.387338 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-b5cf090c-41f1-407e-84f2-1d61c8ee4b26 tempest-VolumesGetTestJSON-141332908 tempest-VolumesGetTestJSON-141332908-project] Action: 'create', calling method: .version_select at 0x7f4bdbdfc040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1144907092", "metadata": {"Type": "work"}}} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:48:15.713498 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-b5cf090c-41f1-407e-84f2-1d61c8ee4b26 tempest-VolumesGetTestJSON-141332908 tempest-VolumesGetTestJSON-141332908-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.462495 Oct 18 11:48:15.714108 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 465/906] 10.222.0.17 () {60 vars in 1156 bytes} [Tue Oct 18 11:48:15 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 464 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 18 11:48:15.728276 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-695eb876-4897-4aa1-a434-50cd4ec853ad tempest-VolumesGetTestJSON-141332908 tempest-VolumesGetTestJSON-141332908-project] Calling method '.version_select at 0x7f4be03e0b80>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:48:15.779542 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-695eb876-4897-4aa1-a434-50cd4ec853ad tempest-VolumesGetTestJSON-141332908 tempest-VolumesGetTestJSON-141332908-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/2d3b61f7-c6ba-4ccf-8760-291eaa6e8e12" status: 200 len: 353 microversion: 2.1 time: 0.055251 Oct 18 11:48:15.780301 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 442/907] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Oct 18 11:48:15 2022] GET /compute/v2.1/os-volumes/2d3b61f7-c6ba-4ccf-8760-291eaa6e8e12 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:48:16.795131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-e03d619f-5f62-4dcc-a770-61c73a275d49 tempest-VolumesGetTestJSON-141332908 tempest-VolumesGetTestJSON-141332908-project] Calling method '.version_select at 0x7f4bdbefd430>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:48:16.847333 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-e03d619f-5f62-4dcc-a770-61c73a275d49 tempest-VolumesGetTestJSON-141332908 tempest-VolumesGetTestJSON-141332908-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/2d3b61f7-c6ba-4ccf-8760-291eaa6e8e12" status: 200 len: 354 microversion: 2.1 time: 0.055618 Oct 18 11:48:16.847901 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 466/908] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Oct 18 11:48:16 2022] GET /compute/v2.1/os-volumes/2d3b61f7-c6ba-4ccf-8760-291eaa6e8e12 => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:48:16.863512 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-d8dd6fb4-5145-4fcf-832d-47206951814e tempest-VolumesGetTestJSON-141332908 tempest-VolumesGetTestJSON-141332908-project] Calling method '.version_select at 0x7f4bdbd2ee50>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:48:16.912989 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-d8dd6fb4-5145-4fcf-832d-47206951814e tempest-VolumesGetTestJSON-141332908 tempest-VolumesGetTestJSON-141332908-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/2d3b61f7-c6ba-4ccf-8760-291eaa6e8e12" status: 200 len: 354 microversion: 2.1 time: 0.053870 Oct 18 11:48:16.913571 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 443/909] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Oct 18 11:48:16 2022] GET /compute/v2.1/os-volumes/2d3b61f7-c6ba-4ccf-8760-291eaa6e8e12 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:48:16.931245 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-e15feef1-48b4-42df-afae-f218ee48297d tempest-VolumesGetTestJSON-141332908 tempest-VolumesGetTestJSON-141332908-project] Calling method '.version_select at 0x7f4bdbe7f8b0>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:48:16.993282 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-e15feef1-48b4-42df-afae-f218ee48297d tempest-VolumesGetTestJSON-141332908 tempest-VolumesGetTestJSON-141332908-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/2d3b61f7-c6ba-4ccf-8760-291eaa6e8e12" status: 202 len: 0 microversion: 2.1 time: 0.065785 Oct 18 11:48:16.993845 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 467/910] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Oct 18 11:48:16 2022] DELETE /compute/v2.1/os-volumes/2d3b61f7-c6ba-4ccf-8760-291eaa6e8e12 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 11:48:17.001838 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-91acc7c2-726e-4ced-b29a-4735b0cccbe9 tempest-VolumesGetTestJSON-141332908 tempest-VolumesGetTestJSON-141332908-project] Calling method '.version_select at 0x7f4bdbfab820>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:48:17.050549 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-91acc7c2-726e-4ced-b29a-4735b0cccbe9 tempest-VolumesGetTestJSON-141332908 tempest-VolumesGetTestJSON-141332908-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/2d3b61f7-c6ba-4ccf-8760-291eaa6e8e12" status: 200 len: 353 microversion: 2.1 time: 0.052531 Oct 18 11:48:17.051110 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 444/911] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Oct 18 11:48:16 2022] GET /compute/v2.1/os-volumes/2d3b61f7-c6ba-4ccf-8760-291eaa6e8e12 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:48:18.064863 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-082149fd-5d5c-4fb3-b419-6db202fa4908 tempest-VolumesGetTestJSON-141332908 tempest-VolumesGetTestJSON-141332908-project] Calling method '.version_select at 0x7f4bdbdfc160>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:48:18.092805 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.wsgi [None req-082149fd-5d5c-4fb3-b419-6db202fa4908 tempest-VolumesGetTestJSON-141332908 tempest-VolumesGetTestJSON-141332908-project] HTTP exception thrown: Volume 2d3b61f7-c6ba-4ccf-8760-291eaa6e8e12 could not be found. Oct 18 11:48:18.094761 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-082149fd-5d5c-4fb3-b419-6db202fa4908 tempest-VolumesGetTestJSON-141332908 tempest-VolumesGetTestJSON-141332908-project] Request method failure captured: Oct 18 11:48:18.094761 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: GET /compute/v2.1/os-volumes/2d3b61f7-c6ba-4ccf-8760-291eaa6e8e12 HTTP/1.1 Oct 18 11:48:18.094761 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:48:18.094761 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:48:18.094761 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:48:18.094761 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 0 Oct 18 11:48:18.094761 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:48:18.094761 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:48:18.094761 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:48:18.094761 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:48:18.094761 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpJ_F5qSCSyAS4UO2yXzPiCnjOw4DQis9oPSLRlEzXZPHPfDa8dXabI2ID2rB8nlpy3VqJEbJOEC6SIJt6isMCVXEDqw82C_wMVeO_M6NiDc3JBp86YgoANT69KCZ8e7-MI5kPZrfLaeYu0CEky_nLKxixd22vql3HbJxqXMoi-Xkeg Oct 18 11:48:18.094761 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:48:18.094761 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:48:18.094761 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:48:18.094761 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:48:18.094761 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:48:18.094761 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:48:18.094761 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: 16d58c86b53f4addbecea9ced3d26716 Oct 18 11:48:18.094761 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-VolumesGetTestJSON-141332908 Oct 18 11:48:18.094761 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:48:18.094761 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:48:18.096979 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/16d58c86b53f4addbecea9ced3d26716"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_16d58c86b53f4addbecea9ced3d26716"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/16d58c86b53f4addbecea9ced3d26716"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/16d58c86b53f4addbecea9ced3d26716"}]}] Oct 18 11:48:18.096979 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-VolumesGetTestJSON-141332908 Oct 18 11:48:18.096979 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: 16d58c86b53f4addbecea9ced3d26716 Oct 18 11:48:18.096979 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-VolumesGetTestJSON-141332908 Oct 18 11:48:18.096979 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-VolumesGetTestJSON-141332908-project Oct 18 11:48:18.096979 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:48:18.096979 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:48:18.096979 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: 400fe30a3db543ed80fe07a0a1089cc6 Oct 18 11:48:18.096979 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-VolumesGetTestJSON-141332908-project Oct 18 11:48:18.096979 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: Oct 18 11:48:18.096979 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Volume 2d3b61f7-c6ba-4ccf-8760-291eaa6e8e12 could not be found. Oct 18 11:48:18.096979 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'id': '2d3b61f7-c6ba-4ccf-8760-291eaa6e8e12'} Oct 18 11:48:18.096979 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:48:18.098011 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:48:18.098011 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 11:48:18.098011 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 11:48:18.098011 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 11:48:18.098011 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 11:48:18.098011 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 11:48:18.098011 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 11:48:18.098011 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 11:48:18.098011 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 11:48:18.098011 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 11:48:18.098011 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 11:48:18.098011 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 11:48:18.098011 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 11:48:18.098011 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 11:48:18.098011 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 11:48:18.098011 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2d3b61f7-c6ba-4ccf-8760-291eaa6e8e12 could not be found. (HTTP 404) (Request-ID: req-719d2465-166c-4370-acfc-485ff1700853) Oct 18 11:48:18.098011 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:48:18.098011 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:48:18.098011 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:48:18.099501 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:48:18.099501 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 18 11:48:18.099501 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 18 11:48:18.099501 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 11:48:18.099501 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 11:48:18.099501 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 11:48:18.099501 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 11:48:18.099501 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 11:48:18.099501 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 11:48:18.099501 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 11:48:18.099501 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 11:48:18.099501 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 11:48:18.099501 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 11:48:18.099501 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 11:48:18.099501 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 11:48:18.099501 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 11:48:18.099501 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 11:48:18.099501 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 11:48:18.099501 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 11:48:18.100970 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 11:48:18.100970 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 11:48:18.100970 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 11:48:18.100970 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 11:48:18.100970 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2d3b61f7-c6ba-4ccf-8760-291eaa6e8e12 could not be found. Oct 18 11:48:18.100970 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:48:18.100970 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:48:18.100970 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:48:18.100970 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:48:18.100970 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:48:18.100970 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:48:18.100970 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:48:18.100970 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:48:18.100970 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 11:48:18.100970 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 11:48:18.100970 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:48:18.100970 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:48:18.100970 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 18 11:48:18.100970 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:48:18.102423 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2d3b61f7-c6ba-4ccf-8760-291eaa6e8e12 could not be found. Oct 18 11:48:18.102423 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:48:18.102423 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:48:18.102423 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:48:18.102423 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:48:18.102423 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:48:18.102423 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:48:18.102423 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:48:18.102423 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:48:18.102423 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2d3b61f7-c6ba-4ccf-8760-291eaa6e8e12 could not be found. Oct 18 11:48:18.102423 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:48:18.102423 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-082149fd-5d5c-4fb3-b419-6db202fa4908 tempest-VolumesGetTestJSON-141332908 tempest-VolumesGetTestJSON-141332908-project] Returning 404 to user: Volume 2d3b61f7-c6ba-4ccf-8760-291eaa6e8e12 could not be found. {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:48:18.102423 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-082149fd-5d5c-4fb3-b419-6db202fa4908 tempest-VolumesGetTestJSON-141332908 tempest-VolumesGetTestJSON-141332908-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/2d3b61f7-c6ba-4ccf-8760-291eaa6e8e12" status: 404 len: 109 microversion: 2.1 time: 0.035748 Oct 18 11:48:18.102423 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 468/912] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Oct 18 11:48:18 2022] GET /compute/v2.1/os-volumes/2d3b61f7-c6ba-4ccf-8760-291eaa6e8e12 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:49:03.841543 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:49:03.842949 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:49:03.848372 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-d4341106-78d1-445c-81b5-33a35d46f308 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1300993780", "imageRef": "a4917b56-ebe0-409a-894a-469900c12b94", "flavorRef": "452", "networks": [{"uuid": "903a1942-4af6-4356-9def-ea9ac0e1b7b4"}]}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:49:03.904511 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.network.neutron [None req-d4341106-78d1-445c-81b5-33a35d46f308 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] validate_networks() for [('903a1942-4af6-4356-9def-ea9ac0e1b7b4', None, None, None, None, None)] {{(pid=125486) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 11:49:04.339760 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-d4341106-78d1-445c-81b5-33a35d46f308 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Flavor limits 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 11:49:04.340162 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-d4341106-78d1-445c-81b5-33a35d46f308 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Image limits 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 11:49:04.340625 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-d4341106-78d1-445c-81b5-33a35d46f308 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Flavor pref 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 11:49:04.341054 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-d4341106-78d1-445c-81b5-33a35d46f308 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Image pref 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 11:49:04.341457 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-d4341106-78d1-445c-81b5-33a35d46f308 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 11:49:04.350147 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d4341106-78d1-445c-81b5-33a35d46f308 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:04.350621 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d4341106-78d1-445c-81b5-33a35d46f308 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:04.351051 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d4341106-78d1-445c-81b5-33a35d46f308 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:04.351762 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d4341106-78d1-445c-81b5-33a35d46f308 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:04.352208 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d4341106-78d1-445c-81b5-33a35d46f308 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:04.352624 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d4341106-78d1-445c-81b5-33a35d46f308 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:04.369573 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-d4341106-78d1-445c-81b5-33a35d46f308 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Getting quotas for project 4148b7689d7c47f58db95b542570b7e6. Resources: {'cores', 'instances', 'ram'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:49:04.373632 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-d4341106-78d1-445c-81b5-33a35d46f308 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Getting quotas for user 0391499864c140ee971a9e6f6872edb8 and project 4148b7689d7c47f58db95b542570b7e6. Resources: {'cores', 'instances', 'ram'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:49:04.385402 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-d4341106-78d1-445c-81b5-33a35d46f308 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Going to run 1 instances... {{(pid=125486) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 11:49:04.387703 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-d4341106-78d1-445c-81b5-33a35d46f308 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: a734321e-3965-41bf-8dac-ce162495eab4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4917b56-ebe0-409a-894a-469900c12b94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 11:49:04.433519 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-d4341106-78d1-445c-81b5-33a35d46f308 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593427 Oct 18 11:49:04.434229 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 445/913] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Oct 18 11:49:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 11:49:04.446233 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-dfbfe228-b58a-4629-8c80-0dae717c4604 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:49:04.446835 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-dfbfe228-b58a-4629-8c80-0dae717c4604 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: a734321e-3965-41bf-8dac-ce162495eab4] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:49:04.449795 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:49:04.450610 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:49:04.510908 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-dfbfe228-b58a-4629-8c80-0dae717c4604 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0391499864c140ee971a9e6f6872edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4148b7689d7c47f58db95b542570b7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:49:04.520509 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-dfbfe228-b58a-4629-8c80-0dae717c4604 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "GET /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4" status: 200 len: 1219 microversion: 2.1 time: 0.078429 Oct 18 11:49:04.521133 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 469/914] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:49:04 2022] GET /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:49:05.544922 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-9b541118-671e-491a-ae22-9c3556b30d31 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:49:05.546972 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-9b541118-671e-491a-ae22-9c3556b30d31 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: a734321e-3965-41bf-8dac-ce162495eab4] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:49:05.555553 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9b541118-671e-491a-ae22-9c3556b30d31 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:05.556320 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9b541118-671e-491a-ae22-9c3556b30d31 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:05.556993 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9b541118-671e-491a-ae22-9c3556b30d31 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:05.557906 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9b541118-671e-491a-ae22-9c3556b30d31 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:05.558554 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9b541118-671e-491a-ae22-9c3556b30d31 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:05.559182 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9b541118-671e-491a-ae22-9c3556b30d31 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:05.657653 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-9b541118-671e-491a-ae22-9c3556b30d31 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0391499864c140ee971a9e6f6872edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4148b7689d7c47f58db95b542570b7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:49:05.669726 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-9b541118-671e-491a-ae22-9c3556b30d31 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "GET /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4" status: 200 len: 1279 microversion: 2.1 time: 0.129856 Oct 18 11:49:05.684380 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 446/915] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:49:05 2022] GET /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4 => generated 1279 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:49:06.695985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-a2ac105d-5096-4cd2-a376-48f3aacce7b1 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:49:06.696718 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-a2ac105d-5096-4cd2-a376-48f3aacce7b1 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: a734321e-3965-41bf-8dac-ce162495eab4] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:49:06.703929 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a2ac105d-5096-4cd2-a376-48f3aacce7b1 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:06.704491 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a2ac105d-5096-4cd2-a376-48f3aacce7b1 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:06.705352 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a2ac105d-5096-4cd2-a376-48f3aacce7b1 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:06.706375 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a2ac105d-5096-4cd2-a376-48f3aacce7b1 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:06.707061 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a2ac105d-5096-4cd2-a376-48f3aacce7b1 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:06.707486 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a2ac105d-5096-4cd2-a376-48f3aacce7b1 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:06.859570 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-a2ac105d-5096-4cd2-a376-48f3aacce7b1 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0391499864c140ee971a9e6f6872edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4148b7689d7c47f58db95b542570b7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:49:06.868182 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-a2ac105d-5096-4cd2-a376-48f3aacce7b1 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "GET /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4" status: 200 len: 1319 microversion: 2.1 time: 0.176064 Oct 18 11:49:06.868835 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 470/916] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:49:06 2022] GET /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:49:06.973507 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-bc74ec14-1442-4ff9-b2f2-89664ef3db17 req-633b5d12-db24-44ec-b999-1349ff06871a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a734321e-3965-41bf-8dac-ce162495eab4", "tag": "de0ee94e-43f5-49cf-ae68-07e328d622b2"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:49:06.986915 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-bc74ec14-1442-4ff9-b2f2-89664ef3db17 req-633b5d12-db24-44ec-b999-1349ff06871a service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:06.987663 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-bc74ec14-1442-4ff9-b2f2-89664ef3db17 req-633b5d12-db24-44ec-b999-1349ff06871a service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:06.988296 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-bc74ec14-1442-4ff9-b2f2-89664ef3db17 req-633b5d12-db24-44ec-b999-1349ff06871a service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:07.002468 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-bc74ec14-1442-4ff9-b2f2-89664ef3db17 req-633b5d12-db24-44ec-b999-1349ff06871a service nova] Creating event network-changed:de0ee94e-43f5-49cf-ae68-07e328d622b2 for instance a734321e-3965-41bf-8dac-ce162495eab4 on hv-cinder-81558 Oct 18 11:49:07.008309 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-bc74ec14-1442-4ff9-b2f2-89664ef3db17 req-633b5d12-db24-44ec-b999-1349ff06871a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041238 Oct 18 11:49:07.009573 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 447/917] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:49:07.892944 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-4bd82e27-684a-4ce4-9a28-e502d7195a0f tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:49:07.893593 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-4bd82e27-684a-4ce4-9a28-e502d7195a0f tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: a734321e-3965-41bf-8dac-ce162495eab4] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:49:07.900166 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4bd82e27-684a-4ce4-9a28-e502d7195a0f tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:07.900678 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4bd82e27-684a-4ce4-9a28-e502d7195a0f tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:07.901202 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4bd82e27-684a-4ce4-9a28-e502d7195a0f tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:07.901898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4bd82e27-684a-4ce4-9a28-e502d7195a0f tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:07.902348 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4bd82e27-684a-4ce4-9a28-e502d7195a0f tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:07.902841 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4bd82e27-684a-4ce4-9a28-e502d7195a0f tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:08.100770 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-4bd82e27-684a-4ce4-9a28-e502d7195a0f tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0391499864c140ee971a9e6f6872edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4148b7689d7c47f58db95b542570b7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:49:08.108317 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-4bd82e27-684a-4ce4-9a28-e502d7195a0f tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "GET /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4" status: 200 len: 1319 microversion: 2.1 time: 0.220146 Oct 18 11:49:08.108906 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 471/918] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:49:07 2022] GET /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:49:09.132538 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-0d7d3121-4c69-4c24-b007-5e2ff7b1acee tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:49:09.133664 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-0d7d3121-4c69-4c24-b007-5e2ff7b1acee tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: a734321e-3965-41bf-8dac-ce162495eab4] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:49:09.140300 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0d7d3121-4c69-4c24-b007-5e2ff7b1acee tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:09.141044 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0d7d3121-4c69-4c24-b007-5e2ff7b1acee tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:09.141549 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0d7d3121-4c69-4c24-b007-5e2ff7b1acee tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:09.142828 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0d7d3121-4c69-4c24-b007-5e2ff7b1acee tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:09.143397 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0d7d3121-4c69-4c24-b007-5e2ff7b1acee tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:09.143878 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-0d7d3121-4c69-4c24-b007-5e2ff7b1acee tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:09.287658 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-0d7d3121-4c69-4c24-b007-5e2ff7b1acee tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0391499864c140ee971a9e6f6872edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4148b7689d7c47f58db95b542570b7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:49:09.295654 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-0d7d3121-4c69-4c24-b007-5e2ff7b1acee tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "GET /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4" status: 200 len: 1319 microversion: 2.1 time: 0.167790 Oct 18 11:49:09.296204 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 448/919] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:49:09 2022] GET /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:49:10.318999 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-358082ba-98ae-4ac7-8550-b2f2a919eeaf tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:49:10.319576 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-358082ba-98ae-4ac7-8550-b2f2a919eeaf tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: a734321e-3965-41bf-8dac-ce162495eab4] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:49:10.326255 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-358082ba-98ae-4ac7-8550-b2f2a919eeaf tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:10.326728 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-358082ba-98ae-4ac7-8550-b2f2a919eeaf tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:10.327158 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-358082ba-98ae-4ac7-8550-b2f2a919eeaf tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:10.327837 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-358082ba-98ae-4ac7-8550-b2f2a919eeaf tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:10.328319 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-358082ba-98ae-4ac7-8550-b2f2a919eeaf tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:10.328737 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-358082ba-98ae-4ac7-8550-b2f2a919eeaf tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:10.458997 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-358082ba-98ae-4ac7-8550-b2f2a919eeaf tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0391499864c140ee971a9e6f6872edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4148b7689d7c47f58db95b542570b7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:49:10.466567 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-358082ba-98ae-4ac7-8550-b2f2a919eeaf tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "GET /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4" status: 200 len: 1319 microversion: 2.1 time: 0.151580 Oct 18 11:49:10.467120 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 472/920] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:49:10 2022] GET /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:49:10.738573 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-ecb87ebb-7151-4559-96e9-52794c811eaf req-5a1f92ad-d487-468b-9d2b-db00c42cc2db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a734321e-3965-41bf-8dac-ce162495eab4", "name": "network-vif-plugged", "status": "completed", "tag": "de0ee94e-43f5-49cf-ae68-07e328d622b2"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:49:10.749883 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-ecb87ebb-7151-4559-96e9-52794c811eaf req-5a1f92ad-d487-468b-9d2b-db00c42cc2db service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:10.750364 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-ecb87ebb-7151-4559-96e9-52794c811eaf req-5a1f92ad-d487-468b-9d2b-db00c42cc2db service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:10.750790 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-ecb87ebb-7151-4559-96e9-52794c811eaf req-5a1f92ad-d487-468b-9d2b-db00c42cc2db service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:10.762527 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-ecb87ebb-7151-4559-96e9-52794c811eaf req-5a1f92ad-d487-468b-9d2b-db00c42cc2db service nova] Creating event network-vif-plugged:de0ee94e-43f5-49cf-ae68-07e328d622b2 for instance a734321e-3965-41bf-8dac-ce162495eab4 on hv-cinder-81558 Oct 18 11:49:10.767990 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-ecb87ebb-7151-4559-96e9-52794c811eaf req-5a1f92ad-d487-468b-9d2b-db00c42cc2db service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032813 Oct 18 11:49:10.768571 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 449/921] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:49:11.489810 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-727d34ec-e093-4e7b-b684-a047b4c72561 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:49:11.490351 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-727d34ec-e093-4e7b-b684-a047b4c72561 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: a734321e-3965-41bf-8dac-ce162495eab4] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:49:11.496630 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-727d34ec-e093-4e7b-b684-a047b4c72561 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:11.497138 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-727d34ec-e093-4e7b-b684-a047b4c72561 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:11.497572 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-727d34ec-e093-4e7b-b684-a047b4c72561 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:11.498253 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-727d34ec-e093-4e7b-b684-a047b4c72561 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:11.498712 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-727d34ec-e093-4e7b-b684-a047b4c72561 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:11.499119 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-727d34ec-e093-4e7b-b684-a047b4c72561 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:11.624678 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-727d34ec-e093-4e7b-b684-a047b4c72561 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0391499864c140ee971a9e6f6872edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4148b7689d7c47f58db95b542570b7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:49:11.632136 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-727d34ec-e093-4e7b-b684-a047b4c72561 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "GET /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4" status: 200 len: 1319 microversion: 2.1 time: 0.146298 Oct 18 11:49:11.632947 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 473/922] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:49:11 2022] GET /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:49:12.657006 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-7c68b675-7f18-4c87-9563-86461e86014c tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:49:12.657746 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-7c68b675-7f18-4c87-9563-86461e86014c tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: a734321e-3965-41bf-8dac-ce162495eab4] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:49:12.664399 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7c68b675-7f18-4c87-9563-86461e86014c tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:12.665093 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7c68b675-7f18-4c87-9563-86461e86014c tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:12.665582 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7c68b675-7f18-4c87-9563-86461e86014c tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:12.666291 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7c68b675-7f18-4c87-9563-86461e86014c tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:12.666746 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7c68b675-7f18-4c87-9563-86461e86014c tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:12.667204 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7c68b675-7f18-4c87-9563-86461e86014c tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:12.834128 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-7c68b675-7f18-4c87-9563-86461e86014c tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0391499864c140ee971a9e6f6872edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4148b7689d7c47f58db95b542570b7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:49:12.841856 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-7c68b675-7f18-4c87-9563-86461e86014c tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "GET /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4" status: 200 len: 1508 microversion: 2.1 time: 0.190092 Oct 18 11:49:12.842422 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 450/923] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:49:12 2022] GET /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4 => generated 1508 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:49:28.133769 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-fdbe6147-db83-408a-8643-c5badda81dc8 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "435948f5-91b9-45f6-a6d5-19b799c4cc4f", "device": "/dev/sdb"}} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:49:28.137539 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-fdbe6147-db83-408a-8643-c5badda81dc8 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: a734321e-3965-41bf-8dac-ce162495eab4] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:49:28.140028 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell0:SELECT=2 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:49:28.140935 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_api:SELECT=12 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:49:28.141343 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=24 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:49:28.148701 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fdbe6147-db83-408a-8643-c5badda81dc8 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:28.149272 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fdbe6147-db83-408a-8643-c5badda81dc8 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:28.149891 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fdbe6147-db83-408a-8643-c5badda81dc8 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:28.150593 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fdbe6147-db83-408a-8643-c5badda81dc8 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:28.151468 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fdbe6147-db83-408a-8643-c5badda81dc8 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:28.151900 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-fdbe6147-db83-408a-8643-c5badda81dc8 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:28.488770 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-fdbe6147-db83-408a-8643-c5badda81dc8 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "POST /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.358656 Oct 18 11:49:28.493322 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 474/924] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Oct 18 11:49:28 2022] POST /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4/os-volume_attachments => generated 194 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:49:33.008334 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell0:SELECT=2 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:49:33.010704 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell0:SELECT=6 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:49:33.011572 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:49:33.012364 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell1:SELECT=24 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:49:33.250157 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-1d882066-1465-4808-86a7-4d0f2e781abc tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Action: 'create', calling method: .version_select at 0x7f4bdbd2ca60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1505591231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtQzgHXQbeNYTz11tqn9Jng5qCJp5QuGmA8nxxwXub3CxPnafOxddLsdQacZMkTCqBp4YOlt7lnfuRdgX6RHdaXGzr85DvuwUxqH4joqNr/x0PahNKZIRO3UP5qOdyIXw=="}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:49:33.268176 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-1d882066-1465-4808-86a7-4d0f2e781abc tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Getting quotas for project b6ef293a199241bf94848b937058ced5. Resources: {'key_pairs'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:49:33.273129 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-1d882066-1465-4808-86a7-4d0f2e781abc tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Getting quotas for user b69c66f5c4c34e0eb85975cd7d53a90c and project b6ef293a199241bf94848b937058ced5. Resources: {'key_pairs'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:49:33.298472 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-1d882066-1465-4808-86a7-4d0f2e781abc tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.295132 Oct 18 11:49:33.299211 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 451/925] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Oct 18 11:49:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:49:51.345023 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_api:SELECT=2 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:49:51.345875 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:49:51.346968 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 11:49:51.347097 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Tue Oct 18 11:49:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4/os-volume_attachments/435948f5-91b9-45f6-a6d5-19b799c4cc4f (ip 10.222.0.17) !!! Oct 18 11:49:51.352139 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-4296a302-f792-4ffb-96fd-862c5ca1e6b9 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:49:51.352743 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-4296a302-f792-4ffb-96fd-862c5ca1e6b9 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: a734321e-3965-41bf-8dac-ce162495eab4] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:49:51.362390 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4296a302-f792-4ffb-96fd-862c5ca1e6b9 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:51.362876 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4296a302-f792-4ffb-96fd-862c5ca1e6b9 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:51.363301 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4296a302-f792-4ffb-96fd-862c5ca1e6b9 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:51.363986 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4296a302-f792-4ffb-96fd-862c5ca1e6b9 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:51.364436 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4296a302-f792-4ffb-96fd-862c5ca1e6b9 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:51.364875 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-4296a302-f792-4ffb-96fd-862c5ca1e6b9 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:51.446431 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.objects.instance [None req-4296a302-f792-4ffb-96fd-862c5ca1e6b9 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lazy-loading 'services' on Instance uuid a734321e-3965-41bf-8dac-ce162495eab4 {{(pid=125485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:49:51.517598 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-4296a302-f792-4ffb-96fd-862c5ca1e6b9 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4/os-volume_attachments/435948f5-91b9-45f6-a6d5-19b799c4cc4f" status: 202 len: 0 microversion: 2.1 time: 0.173722 Oct 18 11:49:51.518232 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 475/926] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Oct 18 11:49:51 2022] DELETE /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4/os-volume_attachments/435948f5-91b9-45f6-a6d5-19b799c4cc4f => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 11:49:52.006837 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell0:SELECT=4 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:49:52.007586 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:49:52.011649 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-3b014468-3775-465a-9b93-75944e382f32 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-462178649", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1505591231", "security_groups": [{"name": "tempest-secgroup-smoke-2099811028"}], "block_device_mapping_v2": [{"uuid": "0f51bda3-569b-4518-90cd-9bb0fac6ea35", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2a92e700-c94d-4eba-b034-d51769eace5d"}]}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:49:52.131357 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.network.neutron [None req-3b014468-3775-465a-9b93-75944e382f32 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] validate_networks() for [('2a92e700-c94d-4eba-b034-d51769eace5d', None, None, None, None, None)] {{(pid=125486) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 11:49:52.505906 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-3b014468-3775-465a-9b93-75944e382f32 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Flavor limits 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 11:49:52.506354 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-3b014468-3775-465a-9b93-75944e382f32 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Image limits 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 11:49:52.506825 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-3b014468-3775-465a-9b93-75944e382f32 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Flavor pref 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 11:49:52.507229 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-3b014468-3775-465a-9b93-75944e382f32 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Image pref 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 11:49:52.507637 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-3b014468-3775-465a-9b93-75944e382f32 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 11:49:52.517219 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3b014468-3775-465a-9b93-75944e382f32 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:52.517695 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3b014468-3775-465a-9b93-75944e382f32 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:52.518122 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3b014468-3775-465a-9b93-75944e382f32 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:52.518845 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3b014468-3775-465a-9b93-75944e382f32 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:52.519297 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3b014468-3775-465a-9b93-75944e382f32 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:52.519719 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-3b014468-3775-465a-9b93-75944e382f32 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:52.536888 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-3b014468-3775-465a-9b93-75944e382f32 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Getting quotas for project b6ef293a199241bf94848b937058ced5. Resources: {'cores', 'instances', 'ram'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:49:52.540883 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-3b014468-3775-465a-9b93-75944e382f32 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Getting quotas for user b69c66f5c4c34e0eb85975cd7d53a90c and project b6ef293a199241bf94848b937058ced5. Resources: {'cores', 'instances', 'ram'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:49:52.597329 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-3b014468-3775-465a-9b93-75944e382f32 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Going to run 1 instances... {{(pid=125486) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 11:49:52.599487 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-3b014468-3775-465a-9b93-75944e382f32 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: 58655508-af93-42a9-a04e-ac7e98946b7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0f51bda3-569b-4518-90cd-9bb0fac6ea35',volume_size=None,volume_type=None)] {{(pid=125486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 11:49:52.647702 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ae51ea3e-61f8-483e-970d-c166c2a9fc5f tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:49:52.648285 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-ae51ea3e-61f8-483e-970d-c166c2a9fc5f tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: a734321e-3965-41bf-8dac-ce162495eab4] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:49:52.654948 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ae51ea3e-61f8-483e-970d-c166c2a9fc5f tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:52.655433 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ae51ea3e-61f8-483e-970d-c166c2a9fc5f tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:52.655918 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ae51ea3e-61f8-483e-970d-c166c2a9fc5f tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:52.656960 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ae51ea3e-61f8-483e-970d-c166c2a9fc5f tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:52.657566 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ae51ea3e-61f8-483e-970d-c166c2a9fc5f tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:52.658131 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ae51ea3e-61f8-483e-970d-c166c2a9fc5f tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:52.684513 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-ae51ea3e-61f8-483e-970d-c166c2a9fc5f tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: a734321e-3965-41bf-8dac-ce162495eab4] Going to try to terminate instance {{(pid=125485) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 11:49:52.734449 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-3b014468-3775-465a-9b93-75944e382f32 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.729276 Oct 18 11:49:52.735284 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 452/927] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Oct 18 11:49:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 11:49:52.746688 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-eace707e-e341-4d84-9fb2-785d8c3702fd tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:49:52.747325 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-eace707e-e341-4d84-9fb2-785d8c3702fd tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: 58655508-af93-42a9-a04e-ac7e98946b7e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:49:52.771032 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-ae51ea3e-61f8-483e-970d-c166c2a9fc5f tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4" status: 204 len: 0 microversion: 2.1 time: 0.128389 Oct 18 11:49:52.772618 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 476/928] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Oct 18 11:49:52 2022] DELETE /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 11:49:52.782597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-548e5e7e-5982-494b-a882-c4e48ae1e489 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:49:52.783307 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-548e5e7e-5982-494b-a882-c4e48ae1e489 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: a734321e-3965-41bf-8dac-ce162495eab4] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:49:52.789607 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-548e5e7e-5982-494b-a882-c4e48ae1e489 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:52.790086 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-548e5e7e-5982-494b-a882-c4e48ae1e489 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:52.790523 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-548e5e7e-5982-494b-a882-c4e48ae1e489 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:52.791208 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-548e5e7e-5982-494b-a882-c4e48ae1e489 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:52.791858 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-548e5e7e-5982-494b-a882-c4e48ae1e489 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:52.792280 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-548e5e7e-5982-494b-a882-c4e48ae1e489 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:52.810657 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-eace707e-e341-4d84-9fb2-785d8c3702fd tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:49:52.818560 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-eace707e-e341-4d84-9fb2-785d8c3702fd tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e" status: 200 len: 1094 microversion: 2.1 time: 0.076357 Oct 18 11:49:52.819137 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 453/929] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:49:52 2022] GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:49:52.935811 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-548e5e7e-5982-494b-a882-c4e48ae1e489 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0391499864c140ee971a9e6f6872edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4148b7689d7c47f58db95b542570b7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:49:52.944001 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-548e5e7e-5982-494b-a882-c4e48ae1e489 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "GET /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4" status: 200 len: 1514 microversion: 2.1 time: 0.166131 Oct 18 11:49:52.944540 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 477/930] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:49:52 2022] GET /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:49:53.842201 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-bbb62d5d-f87e-4595-84a0-487b5b311d1d tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:49:53.842810 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-bbb62d5d-f87e-4595-84a0-487b5b311d1d tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: 58655508-af93-42a9-a04e-ac7e98946b7e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:49:53.849399 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-bbb62d5d-f87e-4595-84a0-487b5b311d1d tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:53.849877 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-bbb62d5d-f87e-4595-84a0-487b5b311d1d tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:53.850304 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-bbb62d5d-f87e-4595-84a0-487b5b311d1d tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:53.850979 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-bbb62d5d-f87e-4595-84a0-487b5b311d1d tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:53.851422 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-bbb62d5d-f87e-4595-84a0-487b5b311d1d tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:53.851850 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-bbb62d5d-f87e-4595-84a0-487b5b311d1d tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:53.912226 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-bbb62d5d-f87e-4595-84a0-487b5b311d1d tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:49:53.919736 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-bbb62d5d-f87e-4595-84a0-487b5b311d1d tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e" status: 200 len: 1144 microversion: 2.1 time: 0.081377 Oct 18 11:49:53.920324 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 454/931] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:49:53 2022] GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:49:53.968992 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-53121344-df80-4783-b197-c34673b4284a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:49:53.969599 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-53121344-df80-4783-b197-c34673b4284a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: a734321e-3965-41bf-8dac-ce162495eab4] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:49:53.975851 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-53121344-df80-4783-b197-c34673b4284a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:53.976329 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-53121344-df80-4783-b197-c34673b4284a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:53.976911 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-53121344-df80-4783-b197-c34673b4284a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:53.977624 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-53121344-df80-4783-b197-c34673b4284a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:53.978072 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-53121344-df80-4783-b197-c34673b4284a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:53.978492 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-53121344-df80-4783-b197-c34673b4284a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:54.105667 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-53121344-df80-4783-b197-c34673b4284a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0391499864c140ee971a9e6f6872edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4148b7689d7c47f58db95b542570b7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:49:54.113213 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-53121344-df80-4783-b197-c34673b4284a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "GET /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4" status: 200 len: 1514 microversion: 2.1 time: 0.148101 Oct 18 11:49:54.113770 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 478/932] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:49:53 2022] GET /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:49:54.942473 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-d139ce11-ce3e-42e2-a05d-5488f803d467 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:49:54.943244 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-d139ce11-ce3e-42e2-a05d-5488f803d467 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: 58655508-af93-42a9-a04e-ac7e98946b7e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:49:54.951168 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d139ce11-ce3e-42e2-a05d-5488f803d467 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:54.951668 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d139ce11-ce3e-42e2-a05d-5488f803d467 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:54.952083 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d139ce11-ce3e-42e2-a05d-5488f803d467 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:54.953049 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d139ce11-ce3e-42e2-a05d-5488f803d467 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:54.953758 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d139ce11-ce3e-42e2-a05d-5488f803d467 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:54.954184 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d139ce11-ce3e-42e2-a05d-5488f803d467 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:55.090227 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-d139ce11-ce3e-42e2-a05d-5488f803d467 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:49:55.097919 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-d139ce11-ce3e-42e2-a05d-5488f803d467 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e" status: 200 len: 1200 microversion: 2.1 time: 0.159477 Oct 18 11:49:55.098480 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 455/933] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:49:54 2022] GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e => generated 1200 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:49:55.138068 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-33227a3c-a125-4ca3-8c09-fdb5118587e0 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:49:55.139240 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-33227a3c-a125-4ca3-8c09-fdb5118587e0 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: a734321e-3965-41bf-8dac-ce162495eab4] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:49:55.145875 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-33227a3c-a125-4ca3-8c09-fdb5118587e0 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:55.146356 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-33227a3c-a125-4ca3-8c09-fdb5118587e0 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:55.146973 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-33227a3c-a125-4ca3-8c09-fdb5118587e0 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:55.147856 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-33227a3c-a125-4ca3-8c09-fdb5118587e0 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:55.148317 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-33227a3c-a125-4ca3-8c09-fdb5118587e0 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:55.149355 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-33227a3c-a125-4ca3-8c09-fdb5118587e0 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:55.283569 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-33227a3c-a125-4ca3-8c09-fdb5118587e0 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0391499864c140ee971a9e6f6872edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4148b7689d7c47f58db95b542570b7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:49:55.292064 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-33227a3c-a125-4ca3-8c09-fdb5118587e0 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "GET /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4" status: 200 len: 1514 microversion: 2.1 time: 0.158189 Oct 18 11:49:55.292810 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 479/934] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:49:55 2022] GET /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:49:55.442944 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-066a4f23-b59b-4be8-b887-63c3b74f87ba req-90a73689-4f68-4145-b85d-4e034200648b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a734321e-3965-41bf-8dac-ce162495eab4", "name": "network-vif-deleted", "tag": "de0ee94e-43f5-49cf-ae68-07e328d622b2"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:49:55.472925 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-066a4f23-b59b-4be8-b887-63c3b74f87ba req-90a73689-4f68-4145-b85d-4e034200648b service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:55.476086 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-066a4f23-b59b-4be8-b887-63c3b74f87ba req-90a73689-4f68-4145-b85d-4e034200648b service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:55.476978 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-066a4f23-b59b-4be8-b887-63c3b74f87ba req-90a73689-4f68-4145-b85d-4e034200648b service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:55.495269 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-066a4f23-b59b-4be8-b887-63c3b74f87ba req-90a73689-4f68-4145-b85d-4e034200648b service nova] Creating event network-vif-deleted:de0ee94e-43f5-49cf-ae68-07e328d622b2 for instance a734321e-3965-41bf-8dac-ce162495eab4 on hv-cinder-81558 Oct 18 11:49:55.504862 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-066a4f23-b59b-4be8-b887-63c3b74f87ba req-90a73689-4f68-4145-b85d-4e034200648b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066766 Oct 18 11:49:55.505697 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 456/935] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:49:56.123042 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-bc6e22b5-de43-4d64-b854-cd876aba4cc5 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:49:56.123973 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-bc6e22b5-de43-4d64-b854-cd876aba4cc5 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: 58655508-af93-42a9-a04e-ac7e98946b7e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:49:56.130959 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bc6e22b5-de43-4d64-b854-cd876aba4cc5 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:56.131597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bc6e22b5-de43-4d64-b854-cd876aba4cc5 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:56.132405 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bc6e22b5-de43-4d64-b854-cd876aba4cc5 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:56.134406 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bc6e22b5-de43-4d64-b854-cd876aba4cc5 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:56.135721 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bc6e22b5-de43-4d64-b854-cd876aba4cc5 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:56.136390 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-bc6e22b5-de43-4d64-b854-cd876aba4cc5 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:56.279904 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-bc6e22b5-de43-4d64-b854-cd876aba4cc5 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:49:56.288335 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-bc6e22b5-de43-4d64-b854-cd876aba4cc5 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e" status: 200 len: 1266 microversion: 2.1 time: 0.170732 Oct 18 11:49:56.288968 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 480/936] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:49:56 2022] GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:49:56.318096 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-7422c71f-5d80-4122-981f-6aaf2f2d537b tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:49:56.318818 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-7422c71f-5d80-4122-981f-6aaf2f2d537b tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: a734321e-3965-41bf-8dac-ce162495eab4] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:49:56.326121 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7422c71f-5d80-4122-981f-6aaf2f2d537b tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:56.326600 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7422c71f-5d80-4122-981f-6aaf2f2d537b tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:56.327023 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7422c71f-5d80-4122-981f-6aaf2f2d537b tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:56.327706 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7422c71f-5d80-4122-981f-6aaf2f2d537b tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:56.328150 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7422c71f-5d80-4122-981f-6aaf2f2d537b tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:56.328562 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7422c71f-5d80-4122-981f-6aaf2f2d537b tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:56.342242 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.wsgi [None req-7422c71f-5d80-4122-981f-6aaf2f2d537b tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] HTTP exception thrown: Instance a734321e-3965-41bf-8dac-ce162495eab4 could not be found. Oct 18 11:49:56.343862 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-7422c71f-5d80-4122-981f-6aaf2f2d537b tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Request method failure captured: Oct 18 11:49:56.343862 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: request: GET /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4 HTTP/1.1 Oct 18 11:49:56.343862 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept: application/json Oct 18 11:49:56.343862 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Accept-Encoding: identity Oct 18 11:49:56.343862 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Connection: close Oct 18 11:49:56.343862 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Length: 0 Oct 18 11:49:56.343862 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Content-Type: application/json Oct 18 11:49:56.343862 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Host: 10.222.0.17 Oct 18 11:49:56.343862 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Openstack-System-Scope: None Oct 18 11:49:56.343862 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: User-Agent: python-urllib3/1.26.12 Oct 18 11:49:56.343862 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Auth-Token: gAAAAABjTpKuw0xpNd2hw61YlQA1Gzw6V___PO0rAqggyDedVFpNLtXJTOYC-giwFpeNWqjd5yJVYI6sNsgd32WTosYaJ-5BH8eQWZTI9G6SKO2-qpDrKA0V7TgAlzvZw97digMuDwvNpgrm4AR0xMDE9lPDbLAngqIUeIu5ePVn2bE1GFuYNLE Oct 18 11:49:56.343862 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Id: None Oct 18 11:49:56.343862 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Domain-Name: None Oct 18 11:49:56.343862 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Identity-Status: Confirmed Oct 18 11:49:56.343862 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Is-Admin-Project: True Oct 18 11:49:56.343862 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Id: default Oct 18 11:49:56.343862 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Domain-Name: Default Oct 18 11:49:56.343862 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Id: 4148b7689d7c47f58db95b542570b7e6 Oct 18 11:49:56.343862 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1243706330 Oct 18 11:49:56.343862 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Role: reader,member Oct 18 11:49:56.343862 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Roles: reader,member Oct 18 11:49:56.345551 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4148b7689d7c47f58db95b542570b7e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4148b7689d7c47f58db95b542570b7e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4148b7689d7c47f58db95b542570b7e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4148b7689d7c47f58db95b542570b7e6"}]}] Oct 18 11:49:56.345551 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant: tempest-VolumesSnapshotTestJSON-1243706330 Oct 18 11:49:56.345551 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Id: 4148b7689d7c47f58db95b542570b7e6 Oct 18 11:49:56.345551 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1243706330 Oct 18 11:49:56.345551 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User: tempest-VolumesSnapshotTestJSON-1243706330-project Oct 18 11:49:56.345551 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Id: default Oct 18 11:49:56.345551 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Domain-Name: Default Oct 18 11:49:56.345551 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Id: 0391499864c140ee971a9e6f6872edb8 Oct 18 11:49:56.345551 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: X-User-Name: tempest-VolumesSnapshotTestJSON-1243706330-project Oct 18 11:49:56.345551 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: method: > Oct 18 11:49:56.345551 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: exception: Instance a734321e-3965-41bf-8dac-ce162495eab4 could not be found. Oct 18 11:49:56.345551 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: action_args: {'id': 'a734321e-3965-41bf-8dac-ce162495eab4'} Oct 18 11:49:56.346524 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:49:56.346524 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:49:56.346524 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:49:56.346524 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:49:56.346524 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:49:56.346524 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:49:56.346524 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:49:56.346524 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:49:56.346524 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:49:56.346524 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:49:56.346524 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a734321e-3965-41bf-8dac-ce162495eab4 could not be found. Oct 18 11:49:56.346524 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:49:56.346524 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:49:56.346524 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:49:56.346524 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:49:56.346524 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:49:56.346524 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:49:56.346524 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:49:56.346524 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:49:56.346524 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:49:56.348032 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:49:56.348032 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 11:49:56.348032 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 11:49:56.348032 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:49:56.348032 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:49:56.348032 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:49:56.348032 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:49:56.348032 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a734321e-3965-41bf-8dac-ce162495eab4 could not be found. Oct 18 11:49:56.348032 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:49:56.348032 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:49:56.348032 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:49:56.348032 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:49:56.348032 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:49:56.348032 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:49:56.348032 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:49:56.348032 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:49:56.348032 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a734321e-3965-41bf-8dac-ce162495eab4 could not be found. Oct 18 11:49:56.348032 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: ERROR nova.api.openstack.wsgi Oct 18 11:49:56.349451 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-7422c71f-5d80-4122-981f-6aaf2f2d537b tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Returning 404 to user: Instance a734321e-3965-41bf-8dac-ce162495eab4 could not be found. {{(pid=125486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:49:56.349451 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-7422c71f-5d80-4122-981f-6aaf2f2d537b tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "GET /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4" status: 404 len: 111 microversion: 2.1 time: 0.031331 Oct 18 11:49:56.349926 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 457/937] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:49:56 2022] GET /compute/v2.1/servers/a734321e-3965-41bf-8dac-ce162495eab4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:49:57.311395 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-36f31fbe-c3bb-4ea8-82be-31aca1caec25 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:49:57.312001 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-36f31fbe-c3bb-4ea8-82be-31aca1caec25 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: 58655508-af93-42a9-a04e-ac7e98946b7e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:49:57.318453 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-36f31fbe-c3bb-4ea8-82be-31aca1caec25 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:57.318932 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-36f31fbe-c3bb-4ea8-82be-31aca1caec25 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:57.319362 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-36f31fbe-c3bb-4ea8-82be-31aca1caec25 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:57.320042 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-36f31fbe-c3bb-4ea8-82be-31aca1caec25 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:57.321154 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-36f31fbe-c3bb-4ea8-82be-31aca1caec25 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:57.321576 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-36f31fbe-c3bb-4ea8-82be-31aca1caec25 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:57.451421 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-36f31fbe-c3bb-4ea8-82be-31aca1caec25 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:49:57.459020 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-36f31fbe-c3bb-4ea8-82be-31aca1caec25 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e" status: 200 len: 1266 microversion: 2.1 time: 0.151471 Oct 18 11:49:57.459581 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 481/938] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:49:57 2022] GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:49:57.520759 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-2afdddf1-fdab-46fc-8b75-7e7577eb2ea6 req-f0220d8c-860f-4f3f-847e-473879843495 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58655508-af93-42a9-a04e-ac7e98946b7e", "tag": "61152378-b2f2-4e42-ab39-055c74891266"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:49:57.530469 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-2afdddf1-fdab-46fc-8b75-7e7577eb2ea6 req-f0220d8c-860f-4f3f-847e-473879843495 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:57.530944 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-2afdddf1-fdab-46fc-8b75-7e7577eb2ea6 req-f0220d8c-860f-4f3f-847e-473879843495 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:57.531369 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-2afdddf1-fdab-46fc-8b75-7e7577eb2ea6 req-f0220d8c-860f-4f3f-847e-473879843495 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:57.542830 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-2afdddf1-fdab-46fc-8b75-7e7577eb2ea6 req-f0220d8c-860f-4f3f-847e-473879843495 service nova] Creating event network-changed:61152378-b2f2-4e42-ab39-055c74891266 for instance 58655508-af93-42a9-a04e-ac7e98946b7e on hv-cinder-81558 Oct 18 11:49:57.547756 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-2afdddf1-fdab-46fc-8b75-7e7577eb2ea6 req-f0220d8c-860f-4f3f-847e-473879843495 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030560 Oct 18 11:49:57.548543 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 458/939] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:49:58.481619 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-eb89c407-bd86-4573-a948-4b6bb93f523e tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:49:58.482227 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-eb89c407-bd86-4573-a948-4b6bb93f523e tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: 58655508-af93-42a9-a04e-ac7e98946b7e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:49:58.488595 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-eb89c407-bd86-4573-a948-4b6bb93f523e tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:58.489106 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-eb89c407-bd86-4573-a948-4b6bb93f523e tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:58.489533 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-eb89c407-bd86-4573-a948-4b6bb93f523e tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:58.490207 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-eb89c407-bd86-4573-a948-4b6bb93f523e tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:58.490647 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-eb89c407-bd86-4573-a948-4b6bb93f523e tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:58.491061 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-eb89c407-bd86-4573-a948-4b6bb93f523e tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:58.619591 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-eb89c407-bd86-4573-a948-4b6bb93f523e tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:49:58.627191 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-eb89c407-bd86-4573-a948-4b6bb93f523e tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e" status: 200 len: 1266 microversion: 2.1 time: 0.149595 Oct 18 11:49:58.627737 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 482/940] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:49:58 2022] GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:49:59.651486 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-7a801451-03e8-4648-a956-b0859a8f00cb tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:49:59.652216 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-7a801451-03e8-4648-a956-b0859a8f00cb tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: 58655508-af93-42a9-a04e-ac7e98946b7e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:49:59.658460 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7a801451-03e8-4648-a956-b0859a8f00cb tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:59.658946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7a801451-03e8-4648-a956-b0859a8f00cb tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:59.659377 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7a801451-03e8-4648-a956-b0859a8f00cb tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:59.660062 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7a801451-03e8-4648-a956-b0859a8f00cb tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:49:59.660547 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7a801451-03e8-4648-a956-b0859a8f00cb tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:49:59.661260 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-7a801451-03e8-4648-a956-b0859a8f00cb tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:49:59.800060 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-7a801451-03e8-4648-a956-b0859a8f00cb tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:49:59.811076 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-7a801451-03e8-4648-a956-b0859a8f00cb tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e" status: 200 len: 1266 microversion: 2.1 time: 0.164911 Oct 18 11:49:59.811656 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 459/941] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:49:59 2022] GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:50:00.839480 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-d8c81706-2f3f-427b-9ace-21425b8e6ba1 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:50:00.840185 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-d8c81706-2f3f-427b-9ace-21425b8e6ba1 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: 58655508-af93-42a9-a04e-ac7e98946b7e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:50:00.846597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d8c81706-2f3f-427b-9ace-21425b8e6ba1 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:00.847076 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d8c81706-2f3f-427b-9ace-21425b8e6ba1 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:00.847510 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d8c81706-2f3f-427b-9ace-21425b8e6ba1 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:00.848201 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d8c81706-2f3f-427b-9ace-21425b8e6ba1 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:00.848648 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d8c81706-2f3f-427b-9ace-21425b8e6ba1 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:00.849293 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d8c81706-2f3f-427b-9ace-21425b8e6ba1 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:00.988705 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-d8c81706-2f3f-427b-9ace-21425b8e6ba1 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:50:00.996634 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-d8c81706-2f3f-427b-9ace-21425b8e6ba1 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e" status: 200 len: 1266 microversion: 2.1 time: 0.161472 Oct 18 11:50:00.997369 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 483/942] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:50:00 2022] GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:50:02.019012 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-c6e41a55-dc03-4248-b3c9-f365833e68de tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:50:02.019622 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-c6e41a55-dc03-4248-b3c9-f365833e68de tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: 58655508-af93-42a9-a04e-ac7e98946b7e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:50:02.026534 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c6e41a55-dc03-4248-b3c9-f365833e68de tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:02.027016 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c6e41a55-dc03-4248-b3c9-f365833e68de tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:02.027448 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c6e41a55-dc03-4248-b3c9-f365833e68de tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:02.028139 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c6e41a55-dc03-4248-b3c9-f365833e68de tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:02.028596 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c6e41a55-dc03-4248-b3c9-f365833e68de tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:02.029055 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c6e41a55-dc03-4248-b3c9-f365833e68de tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:02.157356 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-c6e41a55-dc03-4248-b3c9-f365833e68de tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:50:02.164967 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-c6e41a55-dc03-4248-b3c9-f365833e68de tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e" status: 200 len: 1266 microversion: 2.1 time: 0.149885 Oct 18 11:50:02.165528 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 460/943] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:50:02 2022] GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:50:03.186907 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-02b9f356-d22a-48d3-978e-fb087a7e2720 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:50:03.187516 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-02b9f356-d22a-48d3-978e-fb087a7e2720 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: 58655508-af93-42a9-a04e-ac7e98946b7e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:50:03.194164 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-02b9f356-d22a-48d3-978e-fb087a7e2720 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:03.194644 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-02b9f356-d22a-48d3-978e-fb087a7e2720 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:03.195638 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-02b9f356-d22a-48d3-978e-fb087a7e2720 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:03.196321 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-02b9f356-d22a-48d3-978e-fb087a7e2720 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:03.197058 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-02b9f356-d22a-48d3-978e-fb087a7e2720 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:03.197480 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-02b9f356-d22a-48d3-978e-fb087a7e2720 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:03.323327 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-02b9f356-d22a-48d3-978e-fb087a7e2720 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:50:03.330966 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-02b9f356-d22a-48d3-978e-fb087a7e2720 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e" status: 200 len: 1266 microversion: 2.1 time: 0.147897 Oct 18 11:50:03.331531 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 484/944] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:50:03 2022] GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:50:04.206505 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-82e0d198-cdbc-4c8f-8299-1246d5bf81d4 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1419074600", "imageRef": "a4917b56-ebe0-409a-894a-469900c12b94", "flavorRef": "452", "networks": [{"uuid": "903a1942-4af6-4356-9def-ea9ac0e1b7b4"}]}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:50:04.215535 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell0:SELECT=2 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:50:04.216229 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell0:SELECT=8 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:50:04.261289 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.network.neutron [None req-82e0d198-cdbc-4c8f-8299-1246d5bf81d4 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] validate_networks() for [('903a1942-4af6-4356-9def-ea9ac0e1b7b4', None, None, None, None, None)] {{(pid=125486) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 11:50:04.352904 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-19b69b8b-59e7-49f7-82f3-c42201edf549 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:50:04.353453 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-19b69b8b-59e7-49f7-82f3-c42201edf549 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: 58655508-af93-42a9-a04e-ac7e98946b7e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:50:04.359735 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-19b69b8b-59e7-49f7-82f3-c42201edf549 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:04.360204 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-19b69b8b-59e7-49f7-82f3-c42201edf549 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:04.360631 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-19b69b8b-59e7-49f7-82f3-c42201edf549 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:04.361349 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-19b69b8b-59e7-49f7-82f3-c42201edf549 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:04.362103 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-19b69b8b-59e7-49f7-82f3-c42201edf549 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:04.362521 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-19b69b8b-59e7-49f7-82f3-c42201edf549 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:04.497856 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-19b69b8b-59e7-49f7-82f3-c42201edf549 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:50:04.505500 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-19b69b8b-59e7-49f7-82f3-c42201edf549 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e" status: 200 len: 1266 microversion: 2.1 time: 0.156584 Oct 18 11:50:04.506070 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 485/945] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:50:04 2022] GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:50:04.601709 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-82e0d198-cdbc-4c8f-8299-1246d5bf81d4 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Flavor limits 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 11:50:04.602127 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-82e0d198-cdbc-4c8f-8299-1246d5bf81d4 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Image limits 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 11:50:04.602595 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-82e0d198-cdbc-4c8f-8299-1246d5bf81d4 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Flavor pref 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 11:50:04.603047 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-82e0d198-cdbc-4c8f-8299-1246d5bf81d4 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Image pref 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 11:50:04.603421 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-82e0d198-cdbc-4c8f-8299-1246d5bf81d4 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 11:50:04.612070 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-82e0d198-cdbc-4c8f-8299-1246d5bf81d4 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:04.612545 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-82e0d198-cdbc-4c8f-8299-1246d5bf81d4 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:04.613009 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-82e0d198-cdbc-4c8f-8299-1246d5bf81d4 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:04.613725 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-82e0d198-cdbc-4c8f-8299-1246d5bf81d4 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:04.614171 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-82e0d198-cdbc-4c8f-8299-1246d5bf81d4 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:04.614587 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-82e0d198-cdbc-4c8f-8299-1246d5bf81d4 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:04.630545 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-82e0d198-cdbc-4c8f-8299-1246d5bf81d4 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Getting quotas for project 4148b7689d7c47f58db95b542570b7e6. Resources: {'cores', 'instances', 'ram'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:50:04.634417 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-82e0d198-cdbc-4c8f-8299-1246d5bf81d4 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Getting quotas for user 0391499864c140ee971a9e6f6872edb8 and project 4148b7689d7c47f58db95b542570b7e6. Resources: {'cores', 'instances', 'ram'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:50:04.645098 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-82e0d198-cdbc-4c8f-8299-1246d5bf81d4 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Going to run 1 instances... {{(pid=125486) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 11:50:04.647316 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-82e0d198-cdbc-4c8f-8299-1246d5bf81d4 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4917b56-ebe0-409a-894a-469900c12b94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 11:50:04.693609 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-82e0d198-cdbc-4c8f-8299-1246d5bf81d4 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.490965 Oct 18 11:50:04.694249 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 461/946] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Oct 18 11:50:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 11:50:04.705446 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-63c56426-3797-479f-a5e3-f35f3749692a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:50:04.706056 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-63c56426-3797-479f-a5e3-f35f3749692a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:50:04.761210 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-63c56426-3797-479f-a5e3-f35f3749692a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0391499864c140ee971a9e6f6872edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4148b7689d7c47f58db95b542570b7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:50:04.768241 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-63c56426-3797-479f-a5e3-f35f3749692a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "GET /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d" status: 200 len: 1219 microversion: 2.1 time: 0.066576 Oct 18 11:50:04.768931 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 486/947] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:50:04 2022] GET /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:50:05.528800 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-49400869-39b6-47eb-9359-b72470b5d8b7 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:50:05.529453 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-49400869-39b6-47eb-9359-b72470b5d8b7 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: 58655508-af93-42a9-a04e-ac7e98946b7e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:50:05.535442 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-49400869-39b6-47eb-9359-b72470b5d8b7 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:05.535925 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-49400869-39b6-47eb-9359-b72470b5d8b7 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:05.536363 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-49400869-39b6-47eb-9359-b72470b5d8b7 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:05.537082 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-49400869-39b6-47eb-9359-b72470b5d8b7 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:05.537533 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-49400869-39b6-47eb-9359-b72470b5d8b7 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:05.537950 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-49400869-39b6-47eb-9359-b72470b5d8b7 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:05.680648 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-49400869-39b6-47eb-9359-b72470b5d8b7 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:50:05.688291 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-49400869-39b6-47eb-9359-b72470b5d8b7 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e" status: 200 len: 1266 microversion: 2.1 time: 0.163640 Oct 18 11:50:05.688870 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 462/948] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:50:05 2022] GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:50:05.792015 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-0e2617ef-0404-455f-967c-73e26f5703b6 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:50:05.792626 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-0e2617ef-0404-455f-967c-73e26f5703b6 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:50:05.799031 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0e2617ef-0404-455f-967c-73e26f5703b6 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:05.799742 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0e2617ef-0404-455f-967c-73e26f5703b6 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:05.800245 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0e2617ef-0404-455f-967c-73e26f5703b6 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:05.800953 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0e2617ef-0404-455f-967c-73e26f5703b6 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:05.801400 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0e2617ef-0404-455f-967c-73e26f5703b6 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:05.801811 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-0e2617ef-0404-455f-967c-73e26f5703b6 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:05.865066 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-0e2617ef-0404-455f-967c-73e26f5703b6 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0391499864c140ee971a9e6f6872edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4148b7689d7c47f58db95b542570b7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:50:05.873234 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-0e2617ef-0404-455f-967c-73e26f5703b6 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "GET /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d" status: 200 len: 1271 microversion: 2.1 time: 0.085751 Oct 18 11:50:05.873785 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 487/949] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:50:05 2022] GET /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:50:06.710233 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-baf5efef-f565-4b1f-9c53-2e4d70a01e13 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:50:06.710837 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-baf5efef-f565-4b1f-9c53-2e4d70a01e13 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: 58655508-af93-42a9-a04e-ac7e98946b7e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:50:06.717586 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-baf5efef-f565-4b1f-9c53-2e4d70a01e13 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:06.718073 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-baf5efef-f565-4b1f-9c53-2e4d70a01e13 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:06.718513 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-baf5efef-f565-4b1f-9c53-2e4d70a01e13 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:06.719208 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-baf5efef-f565-4b1f-9c53-2e4d70a01e13 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:06.719669 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-baf5efef-f565-4b1f-9c53-2e4d70a01e13 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:06.720114 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-baf5efef-f565-4b1f-9c53-2e4d70a01e13 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:06.895531 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-d3405577-6730-4892-88e9-b7eb8c847013 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:50:06.896163 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-d3405577-6730-4892-88e9-b7eb8c847013 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:50:06.903106 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d3405577-6730-4892-88e9-b7eb8c847013 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:06.903720 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d3405577-6730-4892-88e9-b7eb8c847013 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:06.904006 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d3405577-6730-4892-88e9-b7eb8c847013 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:06.904790 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d3405577-6730-4892-88e9-b7eb8c847013 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:06.905364 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d3405577-6730-4892-88e9-b7eb8c847013 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:06.905839 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-d3405577-6730-4892-88e9-b7eb8c847013 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:06.913132 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-baf5efef-f565-4b1f-9c53-2e4d70a01e13 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:50:06.921807 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-baf5efef-f565-4b1f-9c53-2e4d70a01e13 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e" status: 200 len: 1266 microversion: 2.1 time: 0.215453 Oct 18 11:50:06.922386 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 463/950] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:50:06 2022] GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:50:07.039422 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-d3405577-6730-4892-88e9-b7eb8c847013 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0391499864c140ee971a9e6f6872edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4148b7689d7c47f58db95b542570b7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:50:07.047110 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-d3405577-6730-4892-88e9-b7eb8c847013 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "GET /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d" status: 200 len: 1319 microversion: 2.1 time: 0.155448 Oct 18 11:50:07.047669 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 488/951] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:50:06 2022] GET /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:50:07.557331 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-991b142c-a84f-4f98-bc56-7408b19dbce2 req-47b54411-89d9-45b2-9c79-b97a82eb2e21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d", "tag": "a4f846ea-e5ad-44ed-8824-f50182016f85"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:50:07.567689 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-991b142c-a84f-4f98-bc56-7408b19dbce2 req-47b54411-89d9-45b2-9c79-b97a82eb2e21 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:07.568167 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-991b142c-a84f-4f98-bc56-7408b19dbce2 req-47b54411-89d9-45b2-9c79-b97a82eb2e21 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:07.568795 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-991b142c-a84f-4f98-bc56-7408b19dbce2 req-47b54411-89d9-45b2-9c79-b97a82eb2e21 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:07.581187 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-991b142c-a84f-4f98-bc56-7408b19dbce2 req-47b54411-89d9-45b2-9c79-b97a82eb2e21 service nova] Creating event network-changed:a4f846ea-e5ad-44ed-8824-f50182016f85 for instance e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d on hv-cinder-81558 Oct 18 11:50:07.587909 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-991b142c-a84f-4f98-bc56-7408b19dbce2 req-47b54411-89d9-45b2-9c79-b97a82eb2e21 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034488 Oct 18 11:50:07.588524 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 464/952] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:50:07.946929 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-01a759a2-a720-4079-b1e2-775048fae9df tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:50:07.948247 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-01a759a2-a720-4079-b1e2-775048fae9df tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: 58655508-af93-42a9-a04e-ac7e98946b7e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:50:07.954808 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-01a759a2-a720-4079-b1e2-775048fae9df tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:07.955210 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-01a759a2-a720-4079-b1e2-775048fae9df tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:07.955798 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-01a759a2-a720-4079-b1e2-775048fae9df tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:07.956535 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-01a759a2-a720-4079-b1e2-775048fae9df tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:07.957084 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-01a759a2-a720-4079-b1e2-775048fae9df tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:07.957552 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-01a759a2-a720-4079-b1e2-775048fae9df tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:08.071860 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-37231762-15fe-4efc-9ad1-754134fe109c tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:50:08.074075 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-37231762-15fe-4efc-9ad1-754134fe109c tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:50:08.081095 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-37231762-15fe-4efc-9ad1-754134fe109c tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:08.081889 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-37231762-15fe-4efc-9ad1-754134fe109c tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:08.082502 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-37231762-15fe-4efc-9ad1-754134fe109c tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:08.083514 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-37231762-15fe-4efc-9ad1-754134fe109c tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:08.084132 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-37231762-15fe-4efc-9ad1-754134fe109c tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:08.084716 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-37231762-15fe-4efc-9ad1-754134fe109c tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:08.123166 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-01a759a2-a720-4079-b1e2-775048fae9df tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:50:08.133249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-01a759a2-a720-4079-b1e2-775048fae9df tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e" status: 200 len: 1266 microversion: 2.1 time: 0.190377 Oct 18 11:50:08.140888 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 489/953] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:50:07 2022] GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:50:08.292633 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-37231762-15fe-4efc-9ad1-754134fe109c tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0391499864c140ee971a9e6f6872edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4148b7689d7c47f58db95b542570b7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:50:08.300832 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-37231762-15fe-4efc-9ad1-754134fe109c tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "GET /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d" status: 200 len: 1319 microversion: 2.1 time: 0.233879 Oct 18 11:50:08.301433 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 465/954] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:50:08 2022] GET /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:50:09.156688 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-3913e88d-0e71-42f7-9bb4-991527bee849 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:50:09.157310 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-3913e88d-0e71-42f7-9bb4-991527bee849 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: 58655508-af93-42a9-a04e-ac7e98946b7e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:50:09.164249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3913e88d-0e71-42f7-9bb4-991527bee849 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:09.164730 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3913e88d-0e71-42f7-9bb4-991527bee849 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:09.165190 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3913e88d-0e71-42f7-9bb4-991527bee849 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:09.165918 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3913e88d-0e71-42f7-9bb4-991527bee849 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:09.166366 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3913e88d-0e71-42f7-9bb4-991527bee849 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:09.166790 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3913e88d-0e71-42f7-9bb4-991527bee849 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:09.170945 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:50:09.299224 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-3913e88d-0e71-42f7-9bb4-991527bee849 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:50:09.306922 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-3913e88d-0e71-42f7-9bb4-991527bee849 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e" status: 200 len: 1266 microversion: 2.1 time: 0.154179 Oct 18 11:50:09.307721 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 490/955] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:50:09 2022] GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:50:09.323656 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-caf0ae4a-bef9-4649-aacd-c7d8626c0d07 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:50:09.324295 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-caf0ae4a-bef9-4649-aacd-c7d8626c0d07 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:50:09.330660 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-caf0ae4a-bef9-4649-aacd-c7d8626c0d07 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:09.331142 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-caf0ae4a-bef9-4649-aacd-c7d8626c0d07 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:09.331574 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-caf0ae4a-bef9-4649-aacd-c7d8626c0d07 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:09.332265 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-caf0ae4a-bef9-4649-aacd-c7d8626c0d07 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:09.332714 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-caf0ae4a-bef9-4649-aacd-c7d8626c0d07 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:09.333171 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-caf0ae4a-bef9-4649-aacd-c7d8626c0d07 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:09.543393 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-caf0ae4a-bef9-4649-aacd-c7d8626c0d07 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0391499864c140ee971a9e6f6872edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4148b7689d7c47f58db95b542570b7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:50:09.551737 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-caf0ae4a-bef9-4649-aacd-c7d8626c0d07 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "GET /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d" status: 200 len: 1319 microversion: 2.1 time: 0.232147 Oct 18 11:50:09.552648 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 466/956] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:50:09 2022] GET /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:50:09.775320 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-46a904ff-dd1f-4b40-868a-19137caf7a86 req-4a990a14-ac02-41a0-a273-d3e7a576fab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58655508-af93-42a9-a04e-ac7e98946b7e", "name": "network-vif-plugged", "status": "completed", "tag": "61152378-b2f2-4e42-ab39-055c74891266"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:50:09.784685 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-46a904ff-dd1f-4b40-868a-19137caf7a86 req-4a990a14-ac02-41a0-a273-d3e7a576fab4 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:09.785383 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-46a904ff-dd1f-4b40-868a-19137caf7a86 req-4a990a14-ac02-41a0-a273-d3e7a576fab4 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:09.785928 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-46a904ff-dd1f-4b40-868a-19137caf7a86 req-4a990a14-ac02-41a0-a273-d3e7a576fab4 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:09.798264 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-46a904ff-dd1f-4b40-868a-19137caf7a86 req-4a990a14-ac02-41a0-a273-d3e7a576fab4 service nova] Creating event network-vif-plugged:61152378-b2f2-4e42-ab39-055c74891266 for instance 58655508-af93-42a9-a04e-ac7e98946b7e on hv-cinder-81558 Oct 18 11:50:09.803195 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-46a904ff-dd1f-4b40-868a-19137caf7a86 req-4a990a14-ac02-41a0-a273-d3e7a576fab4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032046 Oct 18 11:50:09.803860 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 491/957] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:50:10.329814 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-51179e00-09bb-4d02-8c41-e81f53777682 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:50:10.330359 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-51179e00-09bb-4d02-8c41-e81f53777682 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: 58655508-af93-42a9-a04e-ac7e98946b7e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:50:10.337424 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-51179e00-09bb-4d02-8c41-e81f53777682 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:10.337909 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-51179e00-09bb-4d02-8c41-e81f53777682 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:10.338349 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-51179e00-09bb-4d02-8c41-e81f53777682 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:10.339036 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-51179e00-09bb-4d02-8c41-e81f53777682 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:10.339492 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-51179e00-09bb-4d02-8c41-e81f53777682 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:10.339916 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-51179e00-09bb-4d02-8c41-e81f53777682 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:10.467172 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-51179e00-09bb-4d02-8c41-e81f53777682 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:50:10.474761 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-51179e00-09bb-4d02-8c41-e81f53777682 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e" status: 200 len: 1266 microversion: 2.1 time: 0.148931 Oct 18 11:50:10.475402 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 467/958] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:50:10 2022] GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:50:10.577231 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ad7c4a0d-8007-48f0-802d-2f44a8c1999d tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:50:10.577926 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-ad7c4a0d-8007-48f0-802d-2f44a8c1999d tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:50:10.584052 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ad7c4a0d-8007-48f0-802d-2f44a8c1999d tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:10.584498 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ad7c4a0d-8007-48f0-802d-2f44a8c1999d tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:10.584958 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ad7c4a0d-8007-48f0-802d-2f44a8c1999d tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:10.586196 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ad7c4a0d-8007-48f0-802d-2f44a8c1999d tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:10.586643 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ad7c4a0d-8007-48f0-802d-2f44a8c1999d tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:10.587062 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ad7c4a0d-8007-48f0-802d-2f44a8c1999d tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:10.716613 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-ad7c4a0d-8007-48f0-802d-2f44a8c1999d tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0391499864c140ee971a9e6f6872edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4148b7689d7c47f58db95b542570b7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:50:10.724165 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-ad7c4a0d-8007-48f0-802d-2f44a8c1999d tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "GET /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d" status: 200 len: 1319 microversion: 2.1 time: 0.151648 Oct 18 11:50:10.724720 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 492/959] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:50:10 2022] GET /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:50:11.497888 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-fbe5b3c3-6a3f-4682-b1b4-bab4abfef9d5 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:50:11.498517 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-fbe5b3c3-6a3f-4682-b1b4-bab4abfef9d5 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: 58655508-af93-42a9-a04e-ac7e98946b7e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:50:11.506112 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fbe5b3c3-6a3f-4682-b1b4-bab4abfef9d5 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:11.506960 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fbe5b3c3-6a3f-4682-b1b4-bab4abfef9d5 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:11.507713 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fbe5b3c3-6a3f-4682-b1b4-bab4abfef9d5 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:11.508665 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fbe5b3c3-6a3f-4682-b1b4-bab4abfef9d5 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:11.509374 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fbe5b3c3-6a3f-4682-b1b4-bab4abfef9d5 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:11.510048 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-fbe5b3c3-6a3f-4682-b1b4-bab4abfef9d5 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:11.653895 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-fbe5b3c3-6a3f-4682-b1b4-bab4abfef9d5 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:50:11.662108 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-fbe5b3c3-6a3f-4682-b1b4-bab4abfef9d5 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e" status: 200 len: 1454 microversion: 2.1 time: 0.168094 Oct 18 11:50:11.662697 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 468/960] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:50:11 2022] GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e => generated 1454 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:50:11.685214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-ad80e91c-3189-4312-9ece-4728224729f3 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:50:11.685951 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-ad80e91c-3189-4312-9ece-4728224729f3 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: 58655508-af93-42a9-a04e-ac7e98946b7e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:50:11.692655 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ad80e91c-3189-4312-9ece-4728224729f3 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:11.693272 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ad80e91c-3189-4312-9ece-4728224729f3 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:11.693775 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ad80e91c-3189-4312-9ece-4728224729f3 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:11.695052 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ad80e91c-3189-4312-9ece-4728224729f3 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:11.695571 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ad80e91c-3189-4312-9ece-4728224729f3 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:11.696060 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-ad80e91c-3189-4312-9ece-4728224729f3 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:11.746993 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-d3528405-7170-4c03-b1c7-e7e3c2cdc884 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:50:11.747847 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-d3528405-7170-4c03-b1c7-e7e3c2cdc884 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:50:11.754046 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d3528405-7170-4c03-b1c7-e7e3c2cdc884 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:11.754535 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d3528405-7170-4c03-b1c7-e7e3c2cdc884 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:11.755078 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d3528405-7170-4c03-b1c7-e7e3c2cdc884 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:11.755722 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d3528405-7170-4c03-b1c7-e7e3c2cdc884 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:11.756177 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d3528405-7170-4c03-b1c7-e7e3c2cdc884 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:11.756645 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-d3528405-7170-4c03-b1c7-e7e3c2cdc884 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:11.841695 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-ad80e91c-3189-4312-9ece-4728224729f3 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:50:11.850586 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-ad80e91c-3189-4312-9ece-4728224729f3 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e" status: 200 len: 1454 microversion: 2.1 time: 0.169284 Oct 18 11:50:11.851526 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 493/961] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:50:11 2022] GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e => generated 1454 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:50:11.856151 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-919a0460-e5a0-46a1-b86f-ece2c8b5e8b8 req-0ffdddf1-013e-4e15-a3d1-08fb738feb2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d", "name": "network-vif-plugged", "status": "completed", "tag": "a4f846ea-e5ad-44ed-8824-f50182016f85"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:50:11.865638 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-919a0460-e5a0-46a1-b86f-ece2c8b5e8b8 req-0ffdddf1-013e-4e15-a3d1-08fb738feb2e service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:11.866102 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-919a0460-e5a0-46a1-b86f-ece2c8b5e8b8 req-0ffdddf1-013e-4e15-a3d1-08fb738feb2e service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:11.866560 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-919a0460-e5a0-46a1-b86f-ece2c8b5e8b8 req-0ffdddf1-013e-4e15-a3d1-08fb738feb2e service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:11.878493 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-919a0460-e5a0-46a1-b86f-ece2c8b5e8b8 req-0ffdddf1-013e-4e15-a3d1-08fb738feb2e service nova] Creating event network-vif-plugged:a4f846ea-e5ad-44ed-8824-f50182016f85 for instance e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d on hv-cinder-81558 Oct 18 11:50:11.884061 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-919a0460-e5a0-46a1-b86f-ece2c8b5e8b8 req-0ffdddf1-013e-4e15-a3d1-08fb738feb2e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031173 Oct 18 11:50:11.885297 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 494/962] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:50:11.903673 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-d3528405-7170-4c03-b1c7-e7e3c2cdc884 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0391499864c140ee971a9e6f6872edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4148b7689d7c47f58db95b542570b7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:50:11.911471 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-d3528405-7170-4c03-b1c7-e7e3c2cdc884 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "GET /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d" status: 200 len: 1319 microversion: 2.1 time: 0.168567 Oct 18 11:50:11.912443 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 469/963] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:50:11 2022] GET /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:50:12.935695 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-8d75d497-8dc5-4bb4-802a-ba130590610d tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:50:12.936380 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-8d75d497-8dc5-4bb4-802a-ba130590610d tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:50:12.942997 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8d75d497-8dc5-4bb4-802a-ba130590610d tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:12.943474 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8d75d497-8dc5-4bb4-802a-ba130590610d tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:12.943904 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8d75d497-8dc5-4bb4-802a-ba130590610d tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:12.946578 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8d75d497-8dc5-4bb4-802a-ba130590610d tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:12.947032 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8d75d497-8dc5-4bb4-802a-ba130590610d tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:12.947489 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-8d75d497-8dc5-4bb4-802a-ba130590610d tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:13.185181 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-8d75d497-8dc5-4bb4-802a-ba130590610d tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0391499864c140ee971a9e6f6872edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4148b7689d7c47f58db95b542570b7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:50:13.192926 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-8d75d497-8dc5-4bb4-802a-ba130590610d tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "GET /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d" status: 200 len: 1319 microversion: 2.1 time: 0.261830 Oct 18 11:50:13.193738 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 495/964] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:50:12 2022] GET /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:50:13.585507 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-7305fbd2-1b82-48d4-8b5c-21d3f86bc730 req-9f91dc05-a6f9-4379-b6e5-dc43e7006ccf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58655508-af93-42a9-a04e-ac7e98946b7e", "tag": "61152378-b2f2-4e42-ab39-055c74891266"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:50:13.594677 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-7305fbd2-1b82-48d4-8b5c-21d3f86bc730 req-9f91dc05-a6f9-4379-b6e5-dc43e7006ccf service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:13.595143 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-7305fbd2-1b82-48d4-8b5c-21d3f86bc730 req-9f91dc05-a6f9-4379-b6e5-dc43e7006ccf service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:13.595559 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-7305fbd2-1b82-48d4-8b5c-21d3f86bc730 req-9f91dc05-a6f9-4379-b6e5-dc43e7006ccf service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:13.606534 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-7305fbd2-1b82-48d4-8b5c-21d3f86bc730 req-9f91dc05-a6f9-4379-b6e5-dc43e7006ccf service nova] Creating event network-changed:61152378-b2f2-4e42-ab39-055c74891266 for instance 58655508-af93-42a9-a04e-ac7e98946b7e on hv-cinder-81558 Oct 18 11:50:13.611560 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-7305fbd2-1b82-48d4-8b5c-21d3f86bc730 req-9f91dc05-a6f9-4379-b6e5-dc43e7006ccf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030519 Oct 18 11:50:13.612236 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 470/965] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:50:14.216128 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-de94d528-77c7-456f-b9a6-2e38d54dd4bb tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:50:14.216735 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-de94d528-77c7-456f-b9a6-2e38d54dd4bb tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:50:14.223043 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-de94d528-77c7-456f-b9a6-2e38d54dd4bb tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:14.223521 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-de94d528-77c7-456f-b9a6-2e38d54dd4bb tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:14.223952 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-de94d528-77c7-456f-b9a6-2e38d54dd4bb tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:14.224633 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-de94d528-77c7-456f-b9a6-2e38d54dd4bb tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:14.225104 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-de94d528-77c7-456f-b9a6-2e38d54dd4bb tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:14.225557 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-de94d528-77c7-456f-b9a6-2e38d54dd4bb tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:14.354996 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-de94d528-77c7-456f-b9a6-2e38d54dd4bb tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0391499864c140ee971a9e6f6872edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4148b7689d7c47f58db95b542570b7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:50:14.363105 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-de94d528-77c7-456f-b9a6-2e38d54dd4bb tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "GET /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d" status: 200 len: 1509 microversion: 2.1 time: 0.150765 Oct 18 11:50:14.363785 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 496/966] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:50:14 2022] GET /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:50:14.387816 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-60d90a7b-9309-4847-8539-f46d7e7cd23e tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d326d36e-d0f5-4c16-8102-f1852c90cf63", "device": "/dev/sdb"}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:50:14.391000 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-60d90a7b-9309-4847-8539-f46d7e7cd23e tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:50:14.397307 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-60d90a7b-9309-4847-8539-f46d7e7cd23e tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:14.397782 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-60d90a7b-9309-4847-8539-f46d7e7cd23e tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:14.398210 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-60d90a7b-9309-4847-8539-f46d7e7cd23e tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:14.398886 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-60d90a7b-9309-4847-8539-f46d7e7cd23e tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:14.399330 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-60d90a7b-9309-4847-8539-f46d7e7cd23e tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:14.399746 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-60d90a7b-9309-4847-8539-f46d7e7cd23e tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:14.623186 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell0:SELECT=2 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:50:14.640621 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell0:SELECT=6 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:50:14.648703 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-60d90a7b-9309-4847-8539-f46d7e7cd23e tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "POST /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265216 Oct 18 11:50:14.649342 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 471/967] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Oct 18 11:50:14 2022] POST /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:50:32.928198 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-56d35f9d-1b70-4f27-95be-c080f4746f6a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:50:32.928694 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-56d35f9d-1b70-4f27-95be-c080f4746f6a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:50:32.931288 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell0:SELECT=2 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:50:32.932142 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:50:32.932721 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=32 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:50:32.939103 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-56d35f9d-1b70-4f27-95be-c080f4746f6a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:32.939576 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-56d35f9d-1b70-4f27-95be-c080f4746f6a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:32.940003 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-56d35f9d-1b70-4f27-95be-c080f4746f6a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:32.940678 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-56d35f9d-1b70-4f27-95be-c080f4746f6a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:32.941144 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-56d35f9d-1b70-4f27-95be-c080f4746f6a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:32.941559 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-56d35f9d-1b70-4f27-95be-c080f4746f6a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:33.120356 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.objects.instance [None req-56d35f9d-1b70-4f27-95be-c080f4746f6a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lazy-loading 'services' on Instance uuid e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d {{(pid=125485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 11:50:33.191123 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-56d35f9d-1b70-4f27-95be-c080f4746f6a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d/os-volume_attachments/d326d36e-d0f5-4c16-8102-f1852c90cf63" status: 202 len: 0 microversion: 2.1 time: 0.266701 Oct 18 11:50:33.191706 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 497/968] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Oct 18 11:50:32 2022] DELETE /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d/os-volume_attachments/d326d36e-d0f5-4c16-8102-f1852c90cf63 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 11:50:34.310940 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:50:34.311860 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:50:34.316335 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-9acdcd79-7a1a-4024-81a2-c62fe93310c0 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:50:34.316957 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-9acdcd79-7a1a-4024-81a2-c62fe93310c0 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:50:34.324918 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9acdcd79-7a1a-4024-81a2-c62fe93310c0 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:34.325410 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9acdcd79-7a1a-4024-81a2-c62fe93310c0 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:34.325917 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9acdcd79-7a1a-4024-81a2-c62fe93310c0 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:34.326611 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9acdcd79-7a1a-4024-81a2-c62fe93310c0 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:34.327063 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9acdcd79-7a1a-4024-81a2-c62fe93310c0 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:34.327485 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-9acdcd79-7a1a-4024-81a2-c62fe93310c0 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:34.360415 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-9acdcd79-7a1a-4024-81a2-c62fe93310c0 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d] Going to try to terminate instance {{(pid=125486) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 11:50:34.434522 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-9acdcd79-7a1a-4024-81a2-c62fe93310c0 tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d" status: 204 len: 0 microversion: 2.1 time: 0.124727 Oct 18 11:50:34.435257 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 472/969] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Oct 18 11:50:34 2022] DELETE /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 11:50:34.444485 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-b93698ad-cab8-4b6b-961e-87f66df7b21a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:50:34.445214 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-b93698ad-cab8-4b6b-961e-87f66df7b21a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:50:34.451688 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b93698ad-cab8-4b6b-961e-87f66df7b21a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:34.452169 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b93698ad-cab8-4b6b-961e-87f66df7b21a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:34.452608 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b93698ad-cab8-4b6b-961e-87f66df7b21a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:34.453348 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b93698ad-cab8-4b6b-961e-87f66df7b21a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:34.453801 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b93698ad-cab8-4b6b-961e-87f66df7b21a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:34.454221 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b93698ad-cab8-4b6b-961e-87f66df7b21a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:34.586035 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-b93698ad-cab8-4b6b-961e-87f66df7b21a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0391499864c140ee971a9e6f6872edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4148b7689d7c47f58db95b542570b7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:50:34.594489 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-b93698ad-cab8-4b6b-961e-87f66df7b21a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "GET /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d" status: 200 len: 1515 microversion: 2.1 time: 0.154902 Oct 18 11:50:34.595059 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 498/970] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:50:34 2022] GET /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:50:35.618732 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-4b8f07cd-e082-4b12-be0c-29b2105ea65a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:50:35.619432 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-4b8f07cd-e082-4b12-be0c-29b2105ea65a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:50:35.625752 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4b8f07cd-e082-4b12-be0c-29b2105ea65a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:35.626226 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4b8f07cd-e082-4b12-be0c-29b2105ea65a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:35.626655 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4b8f07cd-e082-4b12-be0c-29b2105ea65a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:35.627338 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4b8f07cd-e082-4b12-be0c-29b2105ea65a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:35.627786 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4b8f07cd-e082-4b12-be0c-29b2105ea65a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:35.628205 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4b8f07cd-e082-4b12-be0c-29b2105ea65a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:35.809436 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-4b8f07cd-e082-4b12-be0c-29b2105ea65a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0391499864c140ee971a9e6f6872edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4148b7689d7c47f58db95b542570b7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:50:35.817146 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-4b8f07cd-e082-4b12-be0c-29b2105ea65a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "GET /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d" status: 200 len: 1515 microversion: 2.1 time: 0.202761 Oct 18 11:50:35.817720 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 473/971] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:50:35 2022] GET /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d => generated 1515 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:50:36.842357 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-65ee361a-e219-4378-8dd1-e5b3747d8f5f tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:50:36.842969 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-65ee361a-e219-4378-8dd1-e5b3747d8f5f tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:50:36.849551 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-65ee361a-e219-4378-8dd1-e5b3747d8f5f tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:36.850033 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-65ee361a-e219-4378-8dd1-e5b3747d8f5f tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:36.850472 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-65ee361a-e219-4378-8dd1-e5b3747d8f5f tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:36.851162 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-65ee361a-e219-4378-8dd1-e5b3747d8f5f tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:36.851614 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-65ee361a-e219-4378-8dd1-e5b3747d8f5f tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:36.852693 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-65ee361a-e219-4378-8dd1-e5b3747d8f5f tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:36.915663 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-2054d307-ba98-4542-a6b1-b6da043d8184 req-05591272-0ab8-4982-a7a3-a63cfd14e0db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d", "name": "network-vif-deleted", "tag": "a4f846ea-e5ad-44ed-8824-f50182016f85"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:50:36.926042 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-2054d307-ba98-4542-a6b1-b6da043d8184 req-05591272-0ab8-4982-a7a3-a63cfd14e0db service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:36.926528 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-2054d307-ba98-4542-a6b1-b6da043d8184 req-05591272-0ab8-4982-a7a3-a63cfd14e0db service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:36.926666 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-65ee361a-e219-4378-8dd1-e5b3747d8f5f tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0391499864c140ee971a9e6f6872edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4148b7689d7c47f58db95b542570b7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:50:36.926963 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-2054d307-ba98-4542-a6b1-b6da043d8184 req-05591272-0ab8-4982-a7a3-a63cfd14e0db service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:36.936070 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-65ee361a-e219-4378-8dd1-e5b3747d8f5f tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "GET /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d" status: 200 len: 1473 microversion: 2.1 time: 0.097670 Oct 18 11:50:36.936876 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 499/972] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:50:36 2022] GET /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d => generated 1473 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:50:36.939077 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-2054d307-ba98-4542-a6b1-b6da043d8184 req-05591272-0ab8-4982-a7a3-a63cfd14e0db service nova] Creating event network-vif-deleted:a4f846ea-e5ad-44ed-8824-f50182016f85 for instance e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d on hv-cinder-81558 Oct 18 11:50:36.944231 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-2054d307-ba98-4542-a6b1-b6da043d8184 req-05591272-0ab8-4982-a7a3-a63cfd14e0db service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032814 Oct 18 11:50:36.945114 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 474/973] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:50:37.966534 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-96598dff-867a-4981-b51b-d9df4810bb4a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:50:37.967154 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-96598dff-867a-4981-b51b-d9df4810bb4a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] [instance: e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:50:37.973701 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-96598dff-867a-4981-b51b-d9df4810bb4a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:37.974257 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-96598dff-867a-4981-b51b-d9df4810bb4a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:37.974694 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-96598dff-867a-4981-b51b-d9df4810bb4a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:37.975378 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-96598dff-867a-4981-b51b-d9df4810bb4a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:50:37.975832 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-96598dff-867a-4981-b51b-d9df4810bb4a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:50:37.976255 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-96598dff-867a-4981-b51b-d9df4810bb4a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:50:37.989364 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.wsgi [None req-96598dff-867a-4981-b51b-d9df4810bb4a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] HTTP exception thrown: Instance e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d could not be found. Oct 18 11:50:37.990985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-96598dff-867a-4981-b51b-d9df4810bb4a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Request method failure captured: Oct 18 11:50:37.990985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: GET /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d HTTP/1.1 Oct 18 11:50:37.990985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:50:37.990985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:50:37.990985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:50:37.990985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 0 Oct 18 11:50:37.990985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:50:37.990985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:50:37.990985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:50:37.990985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:50:37.990985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpKuw0xpNd2hw61YlQA1Gzw6V___PO0rAqggyDedVFpNLtXJTOYC-giwFpeNWqjd5yJVYI6sNsgd32WTosYaJ-5BH8eQWZTI9G6SKO2-qpDrKA0V7TgAlzvZw97digMuDwvNpgrm4AR0xMDE9lPDbLAngqIUeIu5ePVn2bE1GFuYNLE Oct 18 11:50:37.990985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:50:37.990985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:50:37.990985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:50:37.990985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:50:37.990985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:50:37.990985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:50:37.990985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: 4148b7689d7c47f58db95b542570b7e6 Oct 18 11:50:37.990985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1243706330 Oct 18 11:50:37.990985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:50:37.990985 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:50:37.992660 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4148b7689d7c47f58db95b542570b7e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4148b7689d7c47f58db95b542570b7e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4148b7689d7c47f58db95b542570b7e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4148b7689d7c47f58db95b542570b7e6"}]}] Oct 18 11:50:37.992660 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-VolumesSnapshotTestJSON-1243706330 Oct 18 11:50:37.992660 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: 4148b7689d7c47f58db95b542570b7e6 Oct 18 11:50:37.992660 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1243706330 Oct 18 11:50:37.992660 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-VolumesSnapshotTestJSON-1243706330-project Oct 18 11:50:37.992660 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:50:37.992660 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:50:37.992660 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: 0391499864c140ee971a9e6f6872edb8 Oct 18 11:50:37.992660 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-VolumesSnapshotTestJSON-1243706330-project Oct 18 11:50:37.992660 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: > Oct 18 11:50:37.992660 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Instance e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d could not be found. Oct 18 11:50:37.992660 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'id': 'e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d'} Oct 18 11:50:37.993665 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:50:37.993665 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:50:37.993665 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:50:37.993665 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:50:37.993665 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:50:37.993665 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:50:37.993665 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:50:37.993665 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:50:37.993665 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:50:37.993665 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:50:37.993665 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d could not be found. Oct 18 11:50:37.993665 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:50:37.993665 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:50:37.993665 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:50:37.993665 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:50:37.993665 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:50:37.993665 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:50:37.993665 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:50:37.993665 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:50:37.993665 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:50:37.995252 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:50:37.995252 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 11:50:37.995252 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 11:50:37.995252 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:50:37.995252 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:50:37.995252 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:50:37.995252 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:50:37.995252 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d could not be found. Oct 18 11:50:37.995252 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:50:37.995252 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:50:37.995252 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:50:37.995252 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:50:37.995252 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:50:37.995252 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:50:37.995252 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:50:37.995252 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:50:37.995252 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d could not be found. Oct 18 11:50:37.995252 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:50:37.996593 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-96598dff-867a-4981-b51b-d9df4810bb4a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] Returning 404 to user: Instance e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d could not be found. {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:50:37.996593 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-96598dff-867a-4981-b51b-d9df4810bb4a tempest-VolumesSnapshotTestJSON-1243706330 tempest-VolumesSnapshotTestJSON-1243706330-project] 10.222.0.17 "GET /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d" status: 404 len: 111 microversion: 2.1 time: 0.029861 Oct 18 11:50:37.996593 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 500/974] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:50:37 2022] GET /compute/v2.1/servers/e4a7f26f-bb4e-4f94-a9f6-25bcd49c356d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:52:21.491829 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 11:52:21.492398 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Tue Oct 18 11:52:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e (ip 10.222.0.17) !!! Oct 18 11:52:21.493078 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:52:21.493823 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:52:21.498857 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-f254803b-1c3b-4c88-bbcb-d538c72ca9e8 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:52:21.499442 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-f254803b-1c3b-4c88-bbcb-d538c72ca9e8 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: 58655508-af93-42a9-a04e-ac7e98946b7e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:52:21.509754 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f254803b-1c3b-4c88-bbcb-d538c72ca9e8 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:21.510228 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f254803b-1c3b-4c88-bbcb-d538c72ca9e8 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:21.510659 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f254803b-1c3b-4c88-bbcb-d538c72ca9e8 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:21.511348 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f254803b-1c3b-4c88-bbcb-d538c72ca9e8 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:21.511799 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f254803b-1c3b-4c88-bbcb-d538c72ca9e8 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:21.512217 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-f254803b-1c3b-4c88-bbcb-d538c72ca9e8 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:21.538766 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-f254803b-1c3b-4c88-bbcb-d538c72ca9e8 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: 58655508-af93-42a9-a04e-ac7e98946b7e] Going to try to terminate instance {{(pid=125486) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 11:52:21.611839 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-f254803b-1c3b-4c88-bbcb-d538c72ca9e8 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "DELETE /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e" status: 204 len: 0 microversion: 2.1 time: 0.122089 Oct 18 11:52:21.612420 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 475/975] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Oct 18 11:52:21 2022] DELETE /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 11:52:21.619680 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 11:52:21.620228 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Tue Oct 18 11:52:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e (ip 10.222.0.17) !!! Oct 18 11:52:21.620994 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_api:SELECT=8 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:52:21.621736 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:52:21.627209 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-227bdb51-7b74-4b2b-b884-5b82149fd9bd tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:52:21.627815 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-227bdb51-7b74-4b2b-b884-5b82149fd9bd tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: 58655508-af93-42a9-a04e-ac7e98946b7e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:52:21.637808 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-227bdb51-7b74-4b2b-b884-5b82149fd9bd tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:21.638289 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-227bdb51-7b74-4b2b-b884-5b82149fd9bd tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:21.638718 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-227bdb51-7b74-4b2b-b884-5b82149fd9bd tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:21.639399 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-227bdb51-7b74-4b2b-b884-5b82149fd9bd tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:21.639851 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-227bdb51-7b74-4b2b-b884-5b82149fd9bd tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:21.640272 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-227bdb51-7b74-4b2b-b884-5b82149fd9bd tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:21.771755 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-227bdb51-7b74-4b2b-b884-5b82149fd9bd tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:52:21.779430 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-227bdb51-7b74-4b2b-b884-5b82149fd9bd tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e" status: 200 len: 1578 microversion: 2.1 time: 0.162615 Oct 18 11:52:21.779992 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 501/976] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:52:21 2022] GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:52:22.804198 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-a111c4eb-ada2-4723-8d70-6b7ceb21ef36 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:52:22.804810 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-a111c4eb-ada2-4723-8d70-6b7ceb21ef36 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: 58655508-af93-42a9-a04e-ac7e98946b7e] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:52:22.811465 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a111c4eb-ada2-4723-8d70-6b7ceb21ef36 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:22.811939 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a111c4eb-ada2-4723-8d70-6b7ceb21ef36 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:22.812363 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a111c4eb-ada2-4723-8d70-6b7ceb21ef36 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:22.813063 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a111c4eb-ada2-4723-8d70-6b7ceb21ef36 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:22.813509 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a111c4eb-ada2-4723-8d70-6b7ceb21ef36 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:22.813922 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-a111c4eb-ada2-4723-8d70-6b7ceb21ef36 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:22.947663 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-a111c4eb-ada2-4723-8d70-6b7ceb21ef36 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:52:22.956228 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-a111c4eb-ada2-4723-8d70-6b7ceb21ef36 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e" status: 200 len: 1578 microversion: 2.1 time: 0.156318 Oct 18 11:52:22.956799 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 476/977] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:52:22 2022] GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:52:23.979947 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-3fde013e-8e0c-41e8-a8cd-80307a0efbc8 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:52:23.981201 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-3fde013e-8e0c-41e8-a8cd-80307a0efbc8 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: 58655508-af93-42a9-a04e-ac7e98946b7e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:52:23.991355 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3fde013e-8e0c-41e8-a8cd-80307a0efbc8 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:23.991840 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3fde013e-8e0c-41e8-a8cd-80307a0efbc8 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:23.992263 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3fde013e-8e0c-41e8-a8cd-80307a0efbc8 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:23.992992 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3fde013e-8e0c-41e8-a8cd-80307a0efbc8 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:23.993433 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3fde013e-8e0c-41e8-a8cd-80307a0efbc8 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:23.993844 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3fde013e-8e0c-41e8-a8cd-80307a0efbc8 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:24.057336 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-3fde013e-8e0c-41e8-a8cd-80307a0efbc8 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:52:24.065612 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-3fde013e-8e0c-41e8-a8cd-80307a0efbc8 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e" status: 200 len: 1510 microversion: 2.1 time: 0.090002 Oct 18 11:52:24.066470 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 502/978] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:52:23 2022] GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e => generated 1510 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:52:24.383556 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-792c1907-6045-4085-a76b-a9f60fbf781e req-febd3ee9-2a1e-4b27-b151-905416682113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58655508-af93-42a9-a04e-ac7e98946b7e", "name": "network-vif-deleted", "tag": "61152378-b2f2-4e42-ab39-055c74891266"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:52:24.395712 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-792c1907-6045-4085-a76b-a9f60fbf781e req-febd3ee9-2a1e-4b27-b151-905416682113 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:24.396297 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-792c1907-6045-4085-a76b-a9f60fbf781e req-febd3ee9-2a1e-4b27-b151-905416682113 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:24.397133 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-792c1907-6045-4085-a76b-a9f60fbf781e req-febd3ee9-2a1e-4b27-b151-905416682113 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:24.415946 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-792c1907-6045-4085-a76b-a9f60fbf781e req-febd3ee9-2a1e-4b27-b151-905416682113 service nova] Creating event network-vif-deleted:61152378-b2f2-4e42-ab39-055c74891266 for instance 58655508-af93-42a9-a04e-ac7e98946b7e on hv-cinder-81558 Oct 18 11:52:24.421328 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-792c1907-6045-4085-a76b-a9f60fbf781e req-febd3ee9-2a1e-4b27-b151-905416682113 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172853 Oct 18 11:52:24.422429 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 477/979] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:52:25.090508 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-772ae4a8-fadc-4a4d-b36d-f483d7f11e77 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:52:25.091122 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-772ae4a8-fadc-4a4d-b36d-f483d7f11e77 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: 58655508-af93-42a9-a04e-ac7e98946b7e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:52:25.097914 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-772ae4a8-fadc-4a4d-b36d-f483d7f11e77 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:25.098443 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-772ae4a8-fadc-4a4d-b36d-f483d7f11e77 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:25.098935 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-772ae4a8-fadc-4a4d-b36d-f483d7f11e77 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:25.099805 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-772ae4a8-fadc-4a4d-b36d-f483d7f11e77 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:25.100264 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-772ae4a8-fadc-4a4d-b36d-f483d7f11e77 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:25.100971 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-772ae4a8-fadc-4a4d-b36d-f483d7f11e77 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:25.116155 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.wsgi [None req-772ae4a8-fadc-4a4d-b36d-f483d7f11e77 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] HTTP exception thrown: Instance 58655508-af93-42a9-a04e-ac7e98946b7e could not be found. Oct 18 11:52:25.117853 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-772ae4a8-fadc-4a4d-b36d-f483d7f11e77 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Request method failure captured: Oct 18 11:52:25.117853 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e HTTP/1.1 Oct 18 11:52:25.117853 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:52:25.117853 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:52:25.117853 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:52:25.117853 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 0 Oct 18 11:52:25.117853 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:52:25.117853 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:52:25.117853 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:52:25.117853 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:52:25.117853 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpLIGfLJpBRbfLV33BVffZ86fvOnui7nfa1bpz0i-1qainKQXRNuWOS_mQDo3RRhxZliNkJdBr4U8dfGfjappquB3nTKfM51fu0QWzNISC0IjKNujzAhOF-LO_bYM5E7U6JC7m3gM3L-C6u4JTMrP1iwuIW7enaKYGog4Ay9CcCaqh0 Oct 18 11:52:25.117853 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:52:25.117853 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:52:25.117853 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:52:25.117853 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:52:25.117853 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:52:25.117853 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:52:25.117853 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: b6ef293a199241bf94848b937058ced5 Oct 18 11:52:25.117853 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-TestVolumeBootPattern-1367009532 Oct 18 11:52:25.117853 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:52:25.117853 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:52:25.119402 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b6ef293a199241bf94848b937058ced5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b6ef293a199241bf94848b937058ced5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b6ef293a199241bf94848b937058ced5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b6ef293a199241bf94848b937058ced5"}]}] Oct 18 11:52:25.119402 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-TestVolumeBootPattern-1367009532 Oct 18 11:52:25.119402 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: b6ef293a199241bf94848b937058ced5 Oct 18 11:52:25.119402 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-TestVolumeBootPattern-1367009532 Oct 18 11:52:25.119402 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-TestVolumeBootPattern-1367009532-project Oct 18 11:52:25.119402 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:52:25.119402 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:52:25.119402 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: b69c66f5c4c34e0eb85975cd7d53a90c Oct 18 11:52:25.119402 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-TestVolumeBootPattern-1367009532-project Oct 18 11:52:25.119402 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: > Oct 18 11:52:25.119402 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Instance 58655508-af93-42a9-a04e-ac7e98946b7e could not be found. Oct 18 11:52:25.119402 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'id': '58655508-af93-42a9-a04e-ac7e98946b7e'} Oct 18 11:52:25.120691 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:52:25.120691 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:52:25.120691 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:52:25.120691 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:52:25.120691 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:52:25.120691 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:52:25.120691 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:52:25.120691 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:52:25.120691 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:52:25.120691 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:52:25.120691 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58655508-af93-42a9-a04e-ac7e98946b7e could not be found. Oct 18 11:52:25.120691 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:52:25.120691 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:52:25.120691 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:52:25.120691 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:52:25.120691 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:52:25.120691 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:52:25.120691 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:52:25.120691 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:52:25.120691 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:52:25.122345 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:52:25.122345 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 11:52:25.122345 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 11:52:25.122345 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:52:25.122345 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:52:25.122345 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:52:25.122345 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:52:25.122345 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58655508-af93-42a9-a04e-ac7e98946b7e could not be found. Oct 18 11:52:25.122345 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:52:25.122345 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:52:25.122345 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:52:25.122345 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:52:25.122345 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:52:25.122345 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:52:25.122345 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:52:25.122345 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:52:25.122345 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58655508-af93-42a9-a04e-ac7e98946b7e could not be found. Oct 18 11:52:25.122345 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:52:25.123786 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-772ae4a8-fadc-4a4d-b36d-f483d7f11e77 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Returning 404 to user: Instance 58655508-af93-42a9-a04e-ac7e98946b7e could not be found. {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:52:25.123786 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-772ae4a8-fadc-4a4d-b36d-f483d7f11e77 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e" status: 404 len: 111 microversion: 2.1 time: 0.033203 Oct 18 11:52:25.123786 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 503/980] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:52:25 2022] GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 11:52:25.231579 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-bc1f7ab8-3ff3-4bb3-8718-db62d4116325 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1147283228", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1505591231", "security_groups": [{"name": "tempest-secgroup-smoke-2099811028"}], "block_device_mapping_v2": [{"uuid": "0f51bda3-569b-4518-90cd-9bb0fac6ea35", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2a92e700-c94d-4eba-b034-d51769eace5d"}]}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:52:25.356082 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.network.neutron [None req-bc1f7ab8-3ff3-4bb3-8718-db62d4116325 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] validate_networks() for [('2a92e700-c94d-4eba-b034-d51769eace5d', None, None, None, None, None)] {{(pid=125486) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 11:52:25.781395 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-bc1f7ab8-3ff3-4bb3-8718-db62d4116325 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Flavor limits 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 11:52:25.782014 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-bc1f7ab8-3ff3-4bb3-8718-db62d4116325 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Image limits 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 11:52:25.782944 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-bc1f7ab8-3ff3-4bb3-8718-db62d4116325 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Flavor pref 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 11:52:25.783405 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-bc1f7ab8-3ff3-4bb3-8718-db62d4116325 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Image pref 0:0:0 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 11:52:25.783812 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.virt.hardware [None req-bc1f7ab8-3ff3-4bb3-8718-db62d4116325 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 11:52:25.792563 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-bc1f7ab8-3ff3-4bb3-8718-db62d4116325 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:25.793091 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-bc1f7ab8-3ff3-4bb3-8718-db62d4116325 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:25.793528 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-bc1f7ab8-3ff3-4bb3-8718-db62d4116325 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:25.794251 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-bc1f7ab8-3ff3-4bb3-8718-db62d4116325 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:25.794707 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-bc1f7ab8-3ff3-4bb3-8718-db62d4116325 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:25.795130 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-bc1f7ab8-3ff3-4bb3-8718-db62d4116325 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:25.811392 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-bc1f7ab8-3ff3-4bb3-8718-db62d4116325 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Getting quotas for project b6ef293a199241bf94848b937058ced5. Resources: {'cores', 'instances', 'ram'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 11:52:25.815411 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.quota [None req-bc1f7ab8-3ff3-4bb3-8718-db62d4116325 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Getting quotas for user b69c66f5c4c34e0eb85975cd7d53a90c and project b6ef293a199241bf94848b937058ced5. Resources: {'cores', 'instances', 'ram'} {{(pid=125486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 11:52:25.871299 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-bc1f7ab8-3ff3-4bb3-8718-db62d4116325 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Going to run 1 instances... {{(pid=125486) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 11:52:25.873590 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-bc1f7ab8-3ff3-4bb3-8718-db62d4116325 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: dbc344a3-4abe-4df2-a572-3a2b08015091] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0f51bda3-569b-4518-90cd-9bb0fac6ea35',volume_size=None,volume_type=None)] {{(pid=125486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 11:52:26.000165 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-bc1f7ab8-3ff3-4bb3-8718-db62d4116325 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.772692 Oct 18 11:52:26.000736 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 478/981] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Oct 18 11:52:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 11:52:26.012286 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-24f729ff-1749-47a7-8403-6c1261abd5b0 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:52:26.013179 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-24f729ff-1749-47a7-8403-6c1261abd5b0 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: dbc344a3-4abe-4df2-a572-3a2b08015091] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:52:26.066536 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-24f729ff-1749-47a7-8403-6c1261abd5b0 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:52:26.074009 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-24f729ff-1749-47a7-8403-6c1261abd5b0 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091" status: 200 len: 1095 microversion: 2.1 time: 0.065471 Oct 18 11:52:26.075152 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 504/982] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:52:26 2022] GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:52:27.097734 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-ae4d3e1c-380b-4810-8ed1-4f3facbc7f0c tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:52:27.098336 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-ae4d3e1c-380b-4810-8ed1-4f3facbc7f0c tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: dbc344a3-4abe-4df2-a572-3a2b08015091] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:52:27.105372 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ae4d3e1c-380b-4810-8ed1-4f3facbc7f0c tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:27.105868 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ae4d3e1c-380b-4810-8ed1-4f3facbc7f0c tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:27.106286 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ae4d3e1c-380b-4810-8ed1-4f3facbc7f0c tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:27.106979 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ae4d3e1c-380b-4810-8ed1-4f3facbc7f0c tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:27.107430 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ae4d3e1c-380b-4810-8ed1-4f3facbc7f0c tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:27.107855 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-ae4d3e1c-380b-4810-8ed1-4f3facbc7f0c tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:27.214486 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-ae4d3e1c-380b-4810-8ed1-4f3facbc7f0c tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:52:27.222867 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-ae4d3e1c-380b-4810-8ed1-4f3facbc7f0c tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091" status: 200 len: 1201 microversion: 2.1 time: 0.130077 Oct 18 11:52:27.223594 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 479/983] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:52:27 2022] GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091 => generated 1201 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:52:28.245721 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-83e40bb5-2aba-4da6-8bbe-8a0f9175d757 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:52:28.246425 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-83e40bb5-2aba-4da6-8bbe-8a0f9175d757 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: dbc344a3-4abe-4df2-a572-3a2b08015091] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:52:28.254972 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-83e40bb5-2aba-4da6-8bbe-8a0f9175d757 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:28.255497 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-83e40bb5-2aba-4da6-8bbe-8a0f9175d757 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:28.255928 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-83e40bb5-2aba-4da6-8bbe-8a0f9175d757 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:28.256993 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-83e40bb5-2aba-4da6-8bbe-8a0f9175d757 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:28.257297 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-83e40bb5-2aba-4da6-8bbe-8a0f9175d757 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:28.257754 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-83e40bb5-2aba-4da6-8bbe-8a0f9175d757 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:28.396607 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-83e40bb5-2aba-4da6-8bbe-8a0f9175d757 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:52:28.404412 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-83e40bb5-2aba-4da6-8bbe-8a0f9175d757 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091" status: 200 len: 1267 microversion: 2.1 time: 0.162574 Oct 18 11:52:28.404993 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 505/984] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:52:28 2022] GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:52:28.775278 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [req-ea918493-8d0b-4cd1-8feb-253b1c9b6285 req-58d9737b-bb56-445e-a773-cca6ac33e82b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbc344a3-4abe-4df2-a572-3a2b08015091", "tag": "1965a684-ccc9-4f08-909b-d902be3e9ac3"}]} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:52:28.788827 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-ea918493-8d0b-4cd1-8feb-253b1c9b6285 req-58d9737b-bb56-445e-a773-cca6ac33e82b service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:28.789638 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-ea918493-8d0b-4cd1-8feb-253b1c9b6285 req-58d9737b-bb56-445e-a773-cca6ac33e82b service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:28.790311 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [req-ea918493-8d0b-4cd1-8feb-253b1c9b6285 req-58d9737b-bb56-445e-a773-cca6ac33e82b service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:28.802259 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.compute.server_external_events [req-ea918493-8d0b-4cd1-8feb-253b1c9b6285 req-58d9737b-bb56-445e-a773-cca6ac33e82b service nova] Creating event network-changed:1965a684-ccc9-4f08-909b-d902be3e9ac3 for instance dbc344a3-4abe-4df2-a572-3a2b08015091 on hv-cinder-81558 Oct 18 11:52:28.807111 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [req-ea918493-8d0b-4cd1-8feb-253b1c9b6285 req-58d9737b-bb56-445e-a773-cca6ac33e82b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036006 Oct 18 11:52:28.807781 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 480/985] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:52:29.427583 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-f8ffda88-7d5f-4afb-a8f9-59407b779e57 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:52:29.428794 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-f8ffda88-7d5f-4afb-a8f9-59407b779e57 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: dbc344a3-4abe-4df2-a572-3a2b08015091] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:52:29.434688 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f8ffda88-7d5f-4afb-a8f9-59407b779e57 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:29.435116 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f8ffda88-7d5f-4afb-a8f9-59407b779e57 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:29.435554 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f8ffda88-7d5f-4afb-a8f9-59407b779e57 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:29.436240 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f8ffda88-7d5f-4afb-a8f9-59407b779e57 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:29.436696 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f8ffda88-7d5f-4afb-a8f9-59407b779e57 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:29.437145 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-f8ffda88-7d5f-4afb-a8f9-59407b779e57 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:29.566619 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-f8ffda88-7d5f-4afb-a8f9-59407b779e57 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:52:29.574327 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-f8ffda88-7d5f-4afb-a8f9-59407b779e57 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091" status: 200 len: 1267 microversion: 2.1 time: 0.150670 Oct 18 11:52:29.575161 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 506/986] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:52:29 2022] GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:52:30.599593 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-377c7153-1838-4964-84fb-ea36f38812dd tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:52:30.600202 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-377c7153-1838-4964-84fb-ea36f38812dd tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: dbc344a3-4abe-4df2-a572-3a2b08015091] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:52:30.606313 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-377c7153-1838-4964-84fb-ea36f38812dd tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:30.606792 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-377c7153-1838-4964-84fb-ea36f38812dd tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:30.607220 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-377c7153-1838-4964-84fb-ea36f38812dd tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:30.607889 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-377c7153-1838-4964-84fb-ea36f38812dd tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:30.608331 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-377c7153-1838-4964-84fb-ea36f38812dd tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:30.608743 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-377c7153-1838-4964-84fb-ea36f38812dd tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:30.744319 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-377c7153-1838-4964-84fb-ea36f38812dd tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:52:30.752042 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-377c7153-1838-4964-84fb-ea36f38812dd tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091" status: 200 len: 1267 microversion: 2.1 time: 0.157761 Oct 18 11:52:30.752599 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 481/987] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:52:30 2022] GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:52:31.773772 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-9a766d30-ab9e-49ed-ae35-bd79961761dc tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:52:31.774412 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-9a766d30-ab9e-49ed-ae35-bd79961761dc tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: dbc344a3-4abe-4df2-a572-3a2b08015091] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:52:31.780862 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9a766d30-ab9e-49ed-ae35-bd79961761dc tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:31.781349 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9a766d30-ab9e-49ed-ae35-bd79961761dc tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:31.781781 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9a766d30-ab9e-49ed-ae35-bd79961761dc tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:31.783082 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9a766d30-ab9e-49ed-ae35-bd79961761dc tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:31.783530 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9a766d30-ab9e-49ed-ae35-bd79961761dc tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:31.783949 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-9a766d30-ab9e-49ed-ae35-bd79961761dc tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:31.917245 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-9a766d30-ab9e-49ed-ae35-bd79961761dc tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:52:31.925467 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-9a766d30-ab9e-49ed-ae35-bd79961761dc tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091" status: 200 len: 1267 microversion: 2.1 time: 0.155508 Oct 18 11:52:31.926055 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 507/988] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:52:31 2022] GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:52:32.948343 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-48ff2959-15be-4c2c-8b90-ef6532b652c7 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:52:32.948956 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-48ff2959-15be-4c2c-8b90-ef6532b652c7 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: dbc344a3-4abe-4df2-a572-3a2b08015091] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:52:32.956170 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-48ff2959-15be-4c2c-8b90-ef6532b652c7 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:32.956650 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-48ff2959-15be-4c2c-8b90-ef6532b652c7 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:32.957103 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-48ff2959-15be-4c2c-8b90-ef6532b652c7 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:32.957774 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-48ff2959-15be-4c2c-8b90-ef6532b652c7 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:32.958217 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-48ff2959-15be-4c2c-8b90-ef6532b652c7 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:32.958630 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-48ff2959-15be-4c2c-8b90-ef6532b652c7 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:33.085301 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-48ff2959-15be-4c2c-8b90-ef6532b652c7 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:52:33.092868 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-48ff2959-15be-4c2c-8b90-ef6532b652c7 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091" status: 200 len: 1267 microversion: 2.1 time: 0.148367 Oct 18 11:52:33.093435 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 482/989] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:52:32 2022] GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:52:34.115165 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-08a3b265-35c1-4539-9e8e-a7c428841161 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:52:34.115750 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-08a3b265-35c1-4539-9e8e-a7c428841161 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: dbc344a3-4abe-4df2-a572-3a2b08015091] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:52:34.122210 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-08a3b265-35c1-4539-9e8e-a7c428841161 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:34.122699 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-08a3b265-35c1-4539-9e8e-a7c428841161 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:34.123129 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-08a3b265-35c1-4539-9e8e-a7c428841161 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:34.123811 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-08a3b265-35c1-4539-9e8e-a7c428841161 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:34.124255 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-08a3b265-35c1-4539-9e8e-a7c428841161 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:34.124669 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-08a3b265-35c1-4539-9e8e-a7c428841161 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:34.253910 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-08a3b265-35c1-4539-9e8e-a7c428841161 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:52:34.261549 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-08a3b265-35c1-4539-9e8e-a7c428841161 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091" status: 200 len: 1267 microversion: 2.1 time: 0.150890 Oct 18 11:52:34.262109 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 508/990] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:52:34 2022] GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:52:35.283733 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-4c7559a7-f700-40a4-bbd1-9a06dd09b6a1 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:52:35.284343 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-4c7559a7-f700-40a4-bbd1-9a06dd09b6a1 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: dbc344a3-4abe-4df2-a572-3a2b08015091] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:52:35.290353 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4c7559a7-f700-40a4-bbd1-9a06dd09b6a1 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:35.290835 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4c7559a7-f700-40a4-bbd1-9a06dd09b6a1 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:35.291268 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4c7559a7-f700-40a4-bbd1-9a06dd09b6a1 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:35.291954 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4c7559a7-f700-40a4-bbd1-9a06dd09b6a1 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:35.292405 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4c7559a7-f700-40a4-bbd1-9a06dd09b6a1 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:35.292827 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4c7559a7-f700-40a4-bbd1-9a06dd09b6a1 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:35.425885 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-4c7559a7-f700-40a4-bbd1-9a06dd09b6a1 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:52:35.433593 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-4c7559a7-f700-40a4-bbd1-9a06dd09b6a1 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091" status: 200 len: 1267 microversion: 2.1 time: 0.153886 Oct 18 11:52:35.434096 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 483/991] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:52:35 2022] GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:52:36.456428 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-e4d69df4-693f-440f-9405-a916573457a1 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:52:36.457087 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-e4d69df4-693f-440f-9405-a916573457a1 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: dbc344a3-4abe-4df2-a572-3a2b08015091] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:52:36.459585 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell0:SELECT=2 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:52:36.464931 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e4d69df4-693f-440f-9405-a916573457a1 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:36.465407 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e4d69df4-693f-440f-9405-a916573457a1 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:36.465911 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e4d69df4-693f-440f-9405-a916573457a1 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:36.466600 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e4d69df4-693f-440f-9405-a916573457a1 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:36.467054 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e4d69df4-693f-440f-9405-a916573457a1 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:36.467607 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e4d69df4-693f-440f-9405-a916573457a1 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:36.596115 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-e4d69df4-693f-440f-9405-a916573457a1 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:52:36.603778 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-e4d69df4-693f-440f-9405-a916573457a1 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091" status: 200 len: 1267 microversion: 2.1 time: 0.151731 Oct 18 11:52:36.604335 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 509/992] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:52:36 2022] GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:52:37.626160 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-e4db4885-a2df-4b7a-9e59-e653804d8d29 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:52:37.626772 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-e4db4885-a2df-4b7a-9e59-e653804d8d29 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: dbc344a3-4abe-4df2-a572-3a2b08015091] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:52:37.628698 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell0:SELECT=2 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:52:37.629405 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell0:SELECT=6 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:52:37.635697 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e4db4885-a2df-4b7a-9e59-e653804d8d29 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:37.636175 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e4db4885-a2df-4b7a-9e59-e653804d8d29 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:37.636609 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e4db4885-a2df-4b7a-9e59-e653804d8d29 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:37.637323 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e4db4885-a2df-4b7a-9e59-e653804d8d29 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:37.637775 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e4db4885-a2df-4b7a-9e59-e653804d8d29 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:37.638197 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-e4db4885-a2df-4b7a-9e59-e653804d8d29 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:37.768219 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-e4db4885-a2df-4b7a-9e59-e653804d8d29 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:52:37.775803 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-e4db4885-a2df-4b7a-9e59-e653804d8d29 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091" status: 200 len: 1267 microversion: 2.1 time: 0.153576 Oct 18 11:52:37.776368 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 484/993] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:52:37 2022] GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:52:38.798737 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-51fedcdf-4a2b-46c8-80b2-6e7f86bf0121 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:52:38.799297 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-51fedcdf-4a2b-46c8-80b2-6e7f86bf0121 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: dbc344a3-4abe-4df2-a572-3a2b08015091] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:52:38.805581 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-51fedcdf-4a2b-46c8-80b2-6e7f86bf0121 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:38.806063 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-51fedcdf-4a2b-46c8-80b2-6e7f86bf0121 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:38.806497 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-51fedcdf-4a2b-46c8-80b2-6e7f86bf0121 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:38.807185 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-51fedcdf-4a2b-46c8-80b2-6e7f86bf0121 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:38.807633 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-51fedcdf-4a2b-46c8-80b2-6e7f86bf0121 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:38.808053 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-51fedcdf-4a2b-46c8-80b2-6e7f86bf0121 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:38.938755 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-51fedcdf-4a2b-46c8-80b2-6e7f86bf0121 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:52:38.946350 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-51fedcdf-4a2b-46c8-80b2-6e7f86bf0121 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091" status: 200 len: 1267 microversion: 2.1 time: 0.152177 Oct 18 11:52:38.946911 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 510/994] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:52:38 2022] GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:52:39.969319 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-4033de1b-1f94-437a-aa10-1dae188ed807 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:52:39.970686 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-4033de1b-1f94-437a-aa10-1dae188ed807 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: dbc344a3-4abe-4df2-a572-3a2b08015091] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:52:39.977699 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4033de1b-1f94-437a-aa10-1dae188ed807 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:39.978186 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4033de1b-1f94-437a-aa10-1dae188ed807 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:39.978627 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4033de1b-1f94-437a-aa10-1dae188ed807 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:39.979315 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4033de1b-1f94-437a-aa10-1dae188ed807 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:39.979766 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4033de1b-1f94-437a-aa10-1dae188ed807 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:39.980188 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-4033de1b-1f94-437a-aa10-1dae188ed807 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:40.111470 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-4033de1b-1f94-437a-aa10-1dae188ed807 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:52:40.119109 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-4033de1b-1f94-437a-aa10-1dae188ed807 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091" status: 200 len: 1267 microversion: 2.1 time: 0.154020 Oct 18 11:52:40.119676 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 485/995] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:52:39 2022] GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:52:40.410237 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-ee788706-6372-4399-a1c3-9d120da82593 req-1806c352-44e2-428b-8f6e-2d4ea9618be7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc344a3-4abe-4df2-a572-3a2b08015091", "name": "network-vif-plugged", "status": "completed", "tag": "1965a684-ccc9-4f08-909b-d902be3e9ac3"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:52:40.419566 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-ee788706-6372-4399-a1c3-9d120da82593 req-1806c352-44e2-428b-8f6e-2d4ea9618be7 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:40.420032 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-ee788706-6372-4399-a1c3-9d120da82593 req-1806c352-44e2-428b-8f6e-2d4ea9618be7 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:40.420452 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-ee788706-6372-4399-a1c3-9d120da82593 req-1806c352-44e2-428b-8f6e-2d4ea9618be7 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:40.430954 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-ee788706-6372-4399-a1c3-9d120da82593 req-1806c352-44e2-428b-8f6e-2d4ea9618be7 service nova] Creating event network-vif-plugged:1965a684-ccc9-4f08-909b-d902be3e9ac3 for instance dbc344a3-4abe-4df2-a572-3a2b08015091 on hv-cinder-81558 Oct 18 11:52:40.436049 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-ee788706-6372-4399-a1c3-9d120da82593 req-1806c352-44e2-428b-8f6e-2d4ea9618be7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090212 Oct 18 11:52:40.436661 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 511/996] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:52:41.141597 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-34804326-4ba2-4dc4-b7b8-75394c87b894 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:52:41.142257 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-34804326-4ba2-4dc4-b7b8-75394c87b894 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: dbc344a3-4abe-4df2-a572-3a2b08015091] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:52:41.148592 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-34804326-4ba2-4dc4-b7b8-75394c87b894 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:41.149090 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-34804326-4ba2-4dc4-b7b8-75394c87b894 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:41.149518 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-34804326-4ba2-4dc4-b7b8-75394c87b894 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:41.150192 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-34804326-4ba2-4dc4-b7b8-75394c87b894 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:41.150639 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-34804326-4ba2-4dc4-b7b8-75394c87b894 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:41.151052 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-34804326-4ba2-4dc4-b7b8-75394c87b894 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:41.281301 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-34804326-4ba2-4dc4-b7b8-75394c87b894 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:52:41.289502 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-34804326-4ba2-4dc4-b7b8-75394c87b894 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091" status: 200 len: 1267 microversion: 2.1 time: 0.151775 Oct 18 11:52:41.290189 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 486/997] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:52:41 2022] GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:52:42.314249 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-e206a2e9-88ab-40ff-b57b-17c6aa920386 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:52:42.314891 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-e206a2e9-88ab-40ff-b57b-17c6aa920386 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: dbc344a3-4abe-4df2-a572-3a2b08015091] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:52:42.321052 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e206a2e9-88ab-40ff-b57b-17c6aa920386 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:42.321527 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e206a2e9-88ab-40ff-b57b-17c6aa920386 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:42.321954 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e206a2e9-88ab-40ff-b57b-17c6aa920386 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:42.322634 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e206a2e9-88ab-40ff-b57b-17c6aa920386 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:42.323082 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e206a2e9-88ab-40ff-b57b-17c6aa920386 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:42.323500 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-e206a2e9-88ab-40ff-b57b-17c6aa920386 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:42.451898 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-e206a2e9-88ab-40ff-b57b-17c6aa920386 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:52:42.459571 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-e206a2e9-88ab-40ff-b57b-17c6aa920386 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091" status: 200 len: 1455 microversion: 2.1 time: 0.150676 Oct 18 11:52:42.460132 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 512/998] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:52:42 2022] GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091 => generated 1455 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:52:42.481146 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-c3badae4-7f4e-4a6f-899e-1070b9cc77df tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:52:42.481763 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.compute.api [None req-c3badae4-7f4e-4a6f-899e-1070b9cc77df tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: dbc344a3-4abe-4df2-a572-3a2b08015091] Fetching instance by UUID {{(pid=125486) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:52:42.488621 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c3badae4-7f4e-4a6f-899e-1070b9cc77df tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:42.489146 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c3badae4-7f4e-4a6f-899e-1070b9cc77df tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:42.489584 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c3badae4-7f4e-4a6f-899e-1070b9cc77df tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:42.490272 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c3badae4-7f4e-4a6f-899e-1070b9cc77df tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:42.490727 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c3badae4-7f4e-4a6f-899e-1070b9cc77df tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:42.491150 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG oslo_concurrency.lockutils [None req-c3badae4-7f4e-4a6f-899e-1070b9cc77df tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:42.622537 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.policy [None req-c3badae4-7f4e-4a6f-899e-1070b9cc77df tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125486) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:52:42.630466 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO nova.api.openstack.requestlog [None req-c3badae4-7f4e-4a6f-899e-1070b9cc77df tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091" status: 200 len: 1455 microversion: 2.1 time: 0.153204 Oct 18 11:52:42.631035 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: [pid: 125486|app: 0|req: 487/999] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:52:42 2022] GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091 => generated 1455 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:52:44.478405 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-e38941f1-343d-462c-8a00-6edaae89eff3 req-0ad0ed7f-08ae-4289-9dbb-600425bd5fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbc344a3-4abe-4df2-a572-3a2b08015091", "tag": "1965a684-ccc9-4f08-909b-d902be3e9ac3"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:52:44.487712 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-e38941f1-343d-462c-8a00-6edaae89eff3 req-0ad0ed7f-08ae-4289-9dbb-600425bd5fd4 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:52:44.488185 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-e38941f1-343d-462c-8a00-6edaae89eff3 req-0ad0ed7f-08ae-4289-9dbb-600425bd5fd4 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:52:44.488608 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-e38941f1-343d-462c-8a00-6edaae89eff3 req-0ad0ed7f-08ae-4289-9dbb-600425bd5fd4 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:52:44.499359 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-e38941f1-343d-462c-8a00-6edaae89eff3 req-0ad0ed7f-08ae-4289-9dbb-600425bd5fd4 service nova] Creating event network-changed:1965a684-ccc9-4f08-909b-d902be3e9ac3 for instance dbc344a3-4abe-4df2-a572-3a2b08015091 on hv-cinder-81558 Oct 18 11:52:44.504362 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-e38941f1-343d-462c-8a00-6edaae89eff3 req-0ad0ed7f-08ae-4289-9dbb-600425bd5fd4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084026 Oct 18 11:52:44.505151 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 513/1000] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:54:29.208778 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:54:29.209559 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:54:29.214393 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.api.openstack.wsgi [None req-0cfef9c3-229a-4b05-a81b-cda02aec10a5 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1059139031", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1505591231", "security_groups": [{"name": "tempest-secgroup-smoke-2099811028"}], "block_device_mapping_v2": [{"uuid": "9b906ef7-a9bf-4696-bb8d-7c4fb09e74ff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2a92e700-c94d-4eba-b034-d51769eace5d"}]}} {{(pid=125486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:54:29.330605 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG nova.network.neutron [None req-0cfef9c3-229a-4b05-a81b-cda02aec10a5 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] validate_networks() for [('2a92e700-c94d-4eba-b034-d51769eace5d', None, None, None, None, None)] {{(pid=125486) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 11:54:39.239646 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: DEBUG dbcounter [-] [125486] Writing DB stats nova_api:SELECT=2 {{(pid=125486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:55:32.452471 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f5a288ed-3e1f-40f6-b936-ab07135dd608] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 11:55:32.453121 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_api:SELECT=28 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:55:32.454117 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG dbcounter [-] [125485] Writing DB stats nova_cell1:SELECT=60 {{(pid=125485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:55:32.455033 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 11:55:32.455179 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Tue Oct 18 11:55:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091 (ip 10.222.0.17) !!! Oct 18 11:55:32.456466 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 11:55:32.456609 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Tue Oct 18 11:55:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091 (ip 10.222.0.17) !!! Oct 18 11:55:32.457697 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 11:55:32.457817 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Tue Oct 18 11:55:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091 (ip 10.222.0.17) !!! Oct 18 11:55:32.464232 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-da476122-312f-4cbb-8a1b-6d423f24a63b tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:55:32.464810 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-da476122-312f-4cbb-8a1b-6d423f24a63b tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: dbc344a3-4abe-4df2-a572-3a2b08015091] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:55:32.481344 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-da476122-312f-4cbb-8a1b-6d423f24a63b tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:55:32.481836 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-da476122-312f-4cbb-8a1b-6d423f24a63b tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:55:32.482253 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-da476122-312f-4cbb-8a1b-6d423f24a63b tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:55:32.482939 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-da476122-312f-4cbb-8a1b-6d423f24a63b tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:55:32.483383 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-da476122-312f-4cbb-8a1b-6d423f24a63b tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:55:32.483801 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-da476122-312f-4cbb-8a1b-6d423f24a63b tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:55:32.511566 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-da476122-312f-4cbb-8a1b-6d423f24a63b tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: dbc344a3-4abe-4df2-a572-3a2b08015091] Going to try to terminate instance {{(pid=125485) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 11:55:32.591330 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-da476122-312f-4cbb-8a1b-6d423f24a63b tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "DELETE /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091" status: 204 len: 0 microversion: 2.1 time: 0.140525 Oct 18 11:55:32.591939 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 514/1001] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Oct 18 11:55:32 2022] DELETE /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 11:55:32.597835 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-02c7d2a0-d3ee-4e19-be2b-3ea110b90de8 req-4122e1f1-baf1-4f78-8bdb-3c8c8597cca9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbc344a3-4abe-4df2-a572-3a2b08015091", "tag": "1965a684-ccc9-4f08-909b-d902be3e9ac3"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:55:32.607122 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-02c7d2a0-d3ee-4e19-be2b-3ea110b90de8 req-4122e1f1-baf1-4f78-8bdb-3c8c8597cca9 service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:55:32.607593 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-02c7d2a0-d3ee-4e19-be2b-3ea110b90de8 req-4122e1f1-baf1-4f78-8bdb-3c8c8597cca9 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:55:32.608009 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-02c7d2a0-d3ee-4e19-be2b-3ea110b90de8 req-4122e1f1-baf1-4f78-8bdb-3c8c8597cca9 service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:55:32.618800 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-02c7d2a0-d3ee-4e19-be2b-3ea110b90de8 req-4122e1f1-baf1-4f78-8bdb-3c8c8597cca9 service nova] Creating event network-changed:1965a684-ccc9-4f08-909b-d902be3e9ac3 for instance dbc344a3-4abe-4df2-a572-3a2b08015091 on hv-cinder-81558 Oct 18 11:55:32.623983 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-02c7d2a0-d3ee-4e19-be2b-3ea110b90de8 req-4122e1f1-baf1-4f78-8bdb-3c8c8597cca9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030106 Oct 18 11:55:32.624727 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 515/1002] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 11:55:32.629540 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-963b270c-a125-4ff2-a978-4fdf5f2825e3 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:55:32.630224 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-963b270c-a125-4ff2-a978-4fdf5f2825e3 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: dbc344a3-4abe-4df2-a572-3a2b08015091] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:55:32.636766 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-963b270c-a125-4ff2-a978-4fdf5f2825e3 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:55:32.637264 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-963b270c-a125-4ff2-a978-4fdf5f2825e3 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:55:32.637691 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-963b270c-a125-4ff2-a978-4fdf5f2825e3 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:55:32.638377 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-963b270c-a125-4ff2-a978-4fdf5f2825e3 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:55:32.638816 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-963b270c-a125-4ff2-a978-4fdf5f2825e3 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:55:32.639226 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-963b270c-a125-4ff2-a978-4fdf5f2825e3 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:55:32.829619 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-963b270c-a125-4ff2-a978-4fdf5f2825e3 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:55:32.837310 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-963b270c-a125-4ff2-a978-4fdf5f2825e3 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091" status: 200 len: 1579 microversion: 2.1 time: 0.211569 Oct 18 11:55:32.837918 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 516/1003] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:55:32 2022] GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091 => generated 1579 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 11:55:33.860891 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-6b70b284-d3cb-405d-92bc-5c2778795399 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:55:33.861531 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-6b70b284-d3cb-405d-92bc-5c2778795399 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: dbc344a3-4abe-4df2-a572-3a2b08015091] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:55:33.869242 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6b70b284-d3cb-405d-92bc-5c2778795399 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:55:33.869763 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6b70b284-d3cb-405d-92bc-5c2778795399 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:55:33.870194 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6b70b284-d3cb-405d-92bc-5c2778795399 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:55:33.870916 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6b70b284-d3cb-405d-92bc-5c2778795399 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:55:33.871364 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6b70b284-d3cb-405d-92bc-5c2778795399 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:55:33.871781 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-6b70b284-d3cb-405d-92bc-5c2778795399 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:55:33.877301 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO oslo.messaging._drivers.impl_rabbit [-] [f5a288ed-3e1f-40f6-b936-ab07135dd608] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 48444. Oct 18 11:55:34.007309 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-6b70b284-d3cb-405d-92bc-5c2778795399 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:55:34.015846 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-6b70b284-d3cb-405d-92bc-5c2778795399 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091" status: 200 len: 1579 microversion: 2.1 time: 0.158885 Oct 18 11:55:34.016409 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 517/1004] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:55:33 2022] GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091 => generated 1579 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:55:34.995916 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [req-462e10ca-69b9-4834-bcd3-88255318b436 req-ed4488b3-cb88-4021-874e-78cb1e401d1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc344a3-4abe-4df2-a572-3a2b08015091", "name": "network-vif-deleted", "tag": "1965a684-ccc9-4f08-909b-d902be3e9ac3"}]} {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 11:55:35.005692 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-462e10ca-69b9-4834-bcd3-88255318b436 req-ed4488b3-cb88-4021-874e-78cb1e401d1a service nova] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:55:35.006164 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-462e10ca-69b9-4834-bcd3-88255318b436 req-ed4488b3-cb88-4021-874e-78cb1e401d1a service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:55:35.006585 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [req-462e10ca-69b9-4834-bcd3-88255318b436 req-ed4488b3-cb88-4021-874e-78cb1e401d1a service nova] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:55:35.018334 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.compute.server_external_events [req-462e10ca-69b9-4834-bcd3-88255318b436 req-ed4488b3-cb88-4021-874e-78cb1e401d1a service nova] Creating event network-vif-deleted:1965a684-ccc9-4f08-909b-d902be3e9ac3 for instance dbc344a3-4abe-4df2-a572-3a2b08015091 on hv-cinder-81558 Oct 18 11:55:35.023271 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [req-462e10ca-69b9-4834-bcd3-88255318b436 req-ed4488b3-cb88-4021-874e-78cb1e401d1a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031520 Oct 18 11:55:35.023860 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 518/1005] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Oct 18 11:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 11:55:35.040049 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-a024556a-a16f-43df-b7e1-eaf1ef0fb440 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:55:35.040731 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-a024556a-a16f-43df-b7e1-eaf1ef0fb440 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: dbc344a3-4abe-4df2-a572-3a2b08015091] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:55:35.046735 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a024556a-a16f-43df-b7e1-eaf1ef0fb440 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:55:35.047210 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a024556a-a16f-43df-b7e1-eaf1ef0fb440 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:55:35.047908 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a024556a-a16f-43df-b7e1-eaf1ef0fb440 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:55:35.048507 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a024556a-a16f-43df-b7e1-eaf1ef0fb440 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:55:35.048973 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a024556a-a16f-43df-b7e1-eaf1ef0fb440 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:55:35.049391 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-a024556a-a16f-43df-b7e1-eaf1ef0fb440 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:55:35.113004 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.policy [None req-a024556a-a16f-43df-b7e1-eaf1ef0fb440 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c66f5c4c34e0eb85975cd7d53a90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ef293a199241bf94848b937058ced5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125485) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 11:55:35.121434 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-a024556a-a16f-43df-b7e1-eaf1ef0fb440 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091" status: 200 len: 1226 microversion: 2.1 time: 0.085449 Oct 18 11:55:35.121988 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 519/1006] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:55:35 2022] GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 11:55:36.143787 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-1ec6db5e-76de-4422-a58a-e628073ffb4d tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:55:36.144438 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-1ec6db5e-76de-4422-a58a-e628073ffb4d tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: dbc344a3-4abe-4df2-a572-3a2b08015091] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:55:36.151391 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1ec6db5e-76de-4422-a58a-e628073ffb4d tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:55:36.151864 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1ec6db5e-76de-4422-a58a-e628073ffb4d tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:55:36.152297 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1ec6db5e-76de-4422-a58a-e628073ffb4d tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:55:36.152994 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1ec6db5e-76de-4422-a58a-e628073ffb4d tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:55:36.153442 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1ec6db5e-76de-4422-a58a-e628073ffb4d tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:55:36.153858 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-1ec6db5e-76de-4422-a58a-e628073ffb4d tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:55:36.166671 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.wsgi [None req-1ec6db5e-76de-4422-a58a-e628073ffb4d tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] HTTP exception thrown: Instance dbc344a3-4abe-4df2-a572-3a2b08015091 could not be found. Oct 18 11:55:36.168296 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-1ec6db5e-76de-4422-a58a-e628073ffb4d tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Request method failure captured: Oct 18 11:55:36.168296 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091 HTTP/1.1 Oct 18 11:55:36.168296 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:55:36.168296 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:55:36.168296 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:55:36.168296 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 0 Oct 18 11:55:36.168296 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:55:36.168296 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:55:36.168296 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:55:36.168296 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:55:36.168296 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpLIGfLJpBRbfLV33BVffZ86fvOnui7nfa1bpz0i-1qainKQXRNuWOS_mQDo3RRhxZliNkJdBr4U8dfGfjappquB3nTKfM51fu0QWzNISC0IjKNujzAhOF-LO_bYM5E7U6JC7m3gM3L-C6u4JTMrP1iwuIW7enaKYGog4Ay9CcCaqh0 Oct 18 11:55:36.168296 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:55:36.168296 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:55:36.168296 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:55:36.168296 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:55:36.168296 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:55:36.168296 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:55:36.168296 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: b6ef293a199241bf94848b937058ced5 Oct 18 11:55:36.168296 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-TestVolumeBootPattern-1367009532 Oct 18 11:55:36.168296 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:55:36.168296 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:55:36.169819 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b6ef293a199241bf94848b937058ced5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b6ef293a199241bf94848b937058ced5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b6ef293a199241bf94848b937058ced5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b6ef293a199241bf94848b937058ced5"}]}] Oct 18 11:55:36.169819 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-TestVolumeBootPattern-1367009532 Oct 18 11:55:36.169819 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: b6ef293a199241bf94848b937058ced5 Oct 18 11:55:36.169819 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-TestVolumeBootPattern-1367009532 Oct 18 11:55:36.169819 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-TestVolumeBootPattern-1367009532-project Oct 18 11:55:36.169819 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:55:36.169819 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:55:36.169819 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: b69c66f5c4c34e0eb85975cd7d53a90c Oct 18 11:55:36.169819 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-TestVolumeBootPattern-1367009532-project Oct 18 11:55:36.169819 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: > Oct 18 11:55:36.169819 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Instance dbc344a3-4abe-4df2-a572-3a2b08015091 could not be found. Oct 18 11:55:36.169819 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'id': 'dbc344a3-4abe-4df2-a572-3a2b08015091'} Oct 18 11:55:36.170702 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:55:36.170702 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:55:36.170702 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:55:36.170702 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:55:36.170702 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:55:36.170702 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:55:36.170702 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:55:36.170702 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:55:36.170702 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:55:36.170702 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:55:36.170702 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbc344a3-4abe-4df2-a572-3a2b08015091 could not be found. Oct 18 11:55:36.170702 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:55:36.170702 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:55:36.170702 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:55:36.170702 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:55:36.170702 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:55:36.170702 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:55:36.170702 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:55:36.170702 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:55:36.170702 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:55:36.172308 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:55:36.172308 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 11:55:36.172308 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 11:55:36.172308 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:55:36.172308 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:55:36.172308 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:55:36.172308 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:55:36.172308 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbc344a3-4abe-4df2-a572-3a2b08015091 could not be found. Oct 18 11:55:36.172308 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:55:36.172308 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:55:36.172308 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:55:36.172308 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:55:36.172308 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:55:36.172308 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:55:36.172308 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:55:36.172308 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:55:36.172308 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbc344a3-4abe-4df2-a572-3a2b08015091 could not be found. Oct 18 11:55:36.172308 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:55:36.173844 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-1ec6db5e-76de-4422-a58a-e628073ffb4d tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Returning 404 to user: Instance dbc344a3-4abe-4df2-a572-3a2b08015091 could not be found. {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:55:36.173844 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-1ec6db5e-76de-4422-a58a-e628073ffb4d tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091" status: 404 len: 111 microversion: 2.1 time: 0.029786 Oct 18 11:55:36.173844 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 520/1007] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:55:36 2022] GET /compute/v2.1/servers/dbc344a3-4abe-4df2-a572-3a2b08015091 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 11:55:36.602661 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-3cd78594-1584-4e1e-98e0-f3310a76b780 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:55:36.603162 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-3cd78594-1584-4e1e-98e0-f3310a76b780 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: 58655508-af93-42a9-a04e-ac7e98946b7e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:55:36.609093 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3cd78594-1584-4e1e-98e0-f3310a76b780 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:55:36.609575 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3cd78594-1584-4e1e-98e0-f3310a76b780 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:55:36.610011 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3cd78594-1584-4e1e-98e0-f3310a76b780 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:55:36.610693 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3cd78594-1584-4e1e-98e0-f3310a76b780 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:55:36.611150 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3cd78594-1584-4e1e-98e0-f3310a76b780 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:55:36.611569 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-3cd78594-1584-4e1e-98e0-f3310a76b780 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:55:36.625092 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.wsgi [None req-3cd78594-1584-4e1e-98e0-f3310a76b780 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] HTTP exception thrown: Instance 58655508-af93-42a9-a04e-ac7e98946b7e could not be found. Oct 18 11:55:36.626602 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-3cd78594-1584-4e1e-98e0-f3310a76b780 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Request method failure captured: Oct 18 11:55:36.626602 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: DELETE /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e HTTP/1.1 Oct 18 11:55:36.626602 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:55:36.626602 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:55:36.626602 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:55:36.626602 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 0 Oct 18 11:55:36.626602 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:55:36.626602 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:55:36.626602 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:55:36.626602 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:55:36.626602 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpLIGfLJpBRbfLV33BVffZ86fvOnui7nfa1bpz0i-1qainKQXRNuWOS_mQDo3RRhxZliNkJdBr4U8dfGfjappquB3nTKfM51fu0QWzNISC0IjKNujzAhOF-LO_bYM5E7U6JC7m3gM3L-C6u4JTMrP1iwuIW7enaKYGog4Ay9CcCaqh0 Oct 18 11:55:36.626602 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:55:36.626602 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:55:36.626602 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:55:36.626602 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:55:36.626602 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:55:36.626602 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:55:36.626602 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: b6ef293a199241bf94848b937058ced5 Oct 18 11:55:36.626602 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-TestVolumeBootPattern-1367009532 Oct 18 11:55:36.626602 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:55:36.626602 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:55:36.628306 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b6ef293a199241bf94848b937058ced5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b6ef293a199241bf94848b937058ced5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b6ef293a199241bf94848b937058ced5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b6ef293a199241bf94848b937058ced5"}]}] Oct 18 11:55:36.628306 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-TestVolumeBootPattern-1367009532 Oct 18 11:55:36.628306 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: b6ef293a199241bf94848b937058ced5 Oct 18 11:55:36.628306 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-TestVolumeBootPattern-1367009532 Oct 18 11:55:36.628306 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-TestVolumeBootPattern-1367009532-project Oct 18 11:55:36.628306 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:55:36.628306 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:55:36.628306 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: b69c66f5c4c34e0eb85975cd7d53a90c Oct 18 11:55:36.628306 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-TestVolumeBootPattern-1367009532-project Oct 18 11:55:36.628306 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: > Oct 18 11:55:36.628306 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Instance 58655508-af93-42a9-a04e-ac7e98946b7e could not be found. Oct 18 11:55:36.628306 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'id': '58655508-af93-42a9-a04e-ac7e98946b7e'} Oct 18 11:55:36.629277 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:55:36.629277 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:55:36.629277 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:55:36.629277 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:55:36.629277 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:55:36.629277 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:55:36.629277 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:55:36.629277 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:55:36.629277 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:55:36.629277 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:55:36.629277 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58655508-af93-42a9-a04e-ac7e98946b7e could not be found. Oct 18 11:55:36.629277 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:55:36.629277 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:55:36.629277 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:55:36.629277 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:55:36.629277 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:55:36.629277 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:55:36.629277 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:55:36.629277 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:55:36.629277 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:55:36.630767 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:55:36.630767 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 11:55:36.630767 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 11:55:36.630767 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 11:55:36.630767 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 11:55:36.630767 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:55:36.630767 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:55:36.630767 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:55:36.630767 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:55:36.630767 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58655508-af93-42a9-a04e-ac7e98946b7e could not be found. Oct 18 11:55:36.630767 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:55:36.630767 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:55:36.630767 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:55:36.630767 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:55:36.630767 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:55:36.630767 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:55:36.630767 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:55:36.630767 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:55:36.630767 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58655508-af93-42a9-a04e-ac7e98946b7e could not be found. Oct 18 11:55:36.630767 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:55:36.632304 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-3cd78594-1584-4e1e-98e0-f3310a76b780 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Returning 404 to user: Instance 58655508-af93-42a9-a04e-ac7e98946b7e could not be found. {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:55:36.632304 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-3cd78594-1584-4e1e-98e0-f3310a76b780 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "DELETE /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e" status: 404 len: 111 microversion: 2.1 time: 0.029176 Oct 18 11:55:36.632304 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 521/1008] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Oct 18 11:55:36 2022] DELETE /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 11:55:36.636427 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-b67a438f-9a48-4eed-b038-3aa339624e57 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:55:36.637063 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.compute.api [None req-b67a438f-9a48-4eed-b038-3aa339624e57 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] [instance: 58655508-af93-42a9-a04e-ac7e98946b7e] Fetching instance by UUID {{(pid=125485) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 11:55:36.642586 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b67a438f-9a48-4eed-b038-3aa339624e57 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:55:36.643064 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b67a438f-9a48-4eed-b038-3aa339624e57 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:55:36.643504 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b67a438f-9a48-4eed-b038-3aa339624e57 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:55:36.644176 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b67a438f-9a48-4eed-b038-3aa339624e57 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Acquiring lock "7aca09e1-1559-4e39-9509-e923bbe1e225" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 11:55:36.644628 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b67a438f-9a48-4eed-b038-3aa339624e57 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 11:55:36.645087 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG oslo_concurrency.lockutils [None req-b67a438f-9a48-4eed-b038-3aa339624e57 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Lock "7aca09e1-1559-4e39-9509-e923bbe1e225" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 11:55:36.660077 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.wsgi [None req-b67a438f-9a48-4eed-b038-3aa339624e57 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] HTTP exception thrown: Instance 58655508-af93-42a9-a04e-ac7e98946b7e could not be found. Oct 18 11:55:36.661597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-b67a438f-9a48-4eed-b038-3aa339624e57 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Request method failure captured: Oct 18 11:55:36.661597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: request: GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e HTTP/1.1 Oct 18 11:55:36.661597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept: application/json Oct 18 11:55:36.661597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Accept-Encoding: identity Oct 18 11:55:36.661597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Connection: close Oct 18 11:55:36.661597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Length: 0 Oct 18 11:55:36.661597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Content-Type: application/json Oct 18 11:55:36.661597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Host: 10.222.0.17 Oct 18 11:55:36.661597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: Openstack-System-Scope: None Oct 18 11:55:36.661597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: User-Agent: python-urllib3/1.26.12 Oct 18 11:55:36.661597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Auth-Token: gAAAAABjTpLIGfLJpBRbfLV33BVffZ86fvOnui7nfa1bpz0i-1qainKQXRNuWOS_mQDo3RRhxZliNkJdBr4U8dfGfjappquB3nTKfM51fu0QWzNISC0IjKNujzAhOF-LO_bYM5E7U6JC7m3gM3L-C6u4JTMrP1iwuIW7enaKYGog4Ay9CcCaqh0 Oct 18 11:55:36.661597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Id: None Oct 18 11:55:36.661597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Domain-Name: None Oct 18 11:55:36.661597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Identity-Status: Confirmed Oct 18 11:55:36.661597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Is-Admin-Project: True Oct 18 11:55:36.661597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Id: default Oct 18 11:55:36.661597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Domain-Name: Default Oct 18 11:55:36.661597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Id: b6ef293a199241bf94848b937058ced5 Oct 18 11:55:36.661597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Project-Name: tempest-TestVolumeBootPattern-1367009532 Oct 18 11:55:36.661597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Role: reader,member Oct 18 11:55:36.661597 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Roles: reader,member Oct 18 11:55:36.663238 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b6ef293a199241bf94848b937058ced5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b6ef293a199241bf94848b937058ced5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b6ef293a199241bf94848b937058ced5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b6ef293a199241bf94848b937058ced5"}]}] Oct 18 11:55:36.663238 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant: tempest-TestVolumeBootPattern-1367009532 Oct 18 11:55:36.663238 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Id: b6ef293a199241bf94848b937058ced5 Oct 18 11:55:36.663238 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-Tenant-Name: tempest-TestVolumeBootPattern-1367009532 Oct 18 11:55:36.663238 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User: tempest-TestVolumeBootPattern-1367009532-project Oct 18 11:55:36.663238 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Id: default Oct 18 11:55:36.663238 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Domain-Name: Default Oct 18 11:55:36.663238 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Id: b69c66f5c4c34e0eb85975cd7d53a90c Oct 18 11:55:36.663238 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: X-User-Name: tempest-TestVolumeBootPattern-1367009532-project Oct 18 11:55:36.663238 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: method: > Oct 18 11:55:36.663238 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: exception: Instance 58655508-af93-42a9-a04e-ac7e98946b7e could not be found. Oct 18 11:55:36.663238 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: action_args: {'id': '58655508-af93-42a9-a04e-ac7e98946b7e'} Oct 18 11:55:36.664142 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 11:55:36.664142 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:55:36.664142 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 11:55:36.664142 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 11:55:36.664142 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 11:55:36.664142 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 11:55:36.664142 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 11:55:36.664142 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 11:55:36.664142 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 11:55:36.664142 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 11:55:36.664142 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58655508-af93-42a9-a04e-ac7e98946b7e could not be found. Oct 18 11:55:36.664142 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:55:36.664142 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:55:36.664142 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:55:36.664142 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:55:36.664142 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:55:36.664142 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:55:36.664142 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 11:55:36.664142 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 11:55:36.664142 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 11:55:36.665690 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 11:55:36.665690 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 11:55:36.665690 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 11:55:36.665690 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 11:55:36.665690 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 11:55:36.665690 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 11:55:36.665690 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 11:55:36.665690 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58655508-af93-42a9-a04e-ac7e98946b7e could not be found. Oct 18 11:55:36.665690 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:55:36.665690 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 11:55:36.665690 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:55:36.665690 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 11:55:36.665690 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 11:55:36.665690 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 11:55:36.665690 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 11:55:36.665690 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 11:55:36.665690 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58655508-af93-42a9-a04e-ac7e98946b7e could not be found. Oct 18 11:55:36.665690 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: ERROR nova.api.openstack.wsgi Oct 18 11:55:36.667068 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-b67a438f-9a48-4eed-b038-3aa339624e57 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Returning 404 to user: Instance 58655508-af93-42a9-a04e-ac7e98946b7e could not be found. {{(pid=125485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 11:55:36.667068 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-b67a438f-9a48-4eed-b038-3aa339624e57 tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e" status: 404 len: 111 microversion: 2.1 time: 0.030550 Oct 18 11:55:36.667068 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 522/1009] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Oct 18 11:55:36 2022] GET /compute/v2.1/servers/58655508-af93-42a9-a04e-ac7e98946b7e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 11:55:37.965336 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: DEBUG nova.api.openstack.wsgi [None req-5c443266-2474-4fff-a0d1-dad7323d9bdb tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] Calling method '.version_select at 0x7f4bdbe7f8b0>' {{(pid=125485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 11:55:37.991858 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: INFO nova.api.openstack.requestlog [None req-5c443266-2474-4fff-a0d1-dad7323d9bdb tempest-TestVolumeBootPattern-1367009532 tempest-TestVolumeBootPattern-1367009532-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1505591231" status: 202 len: 0 microversion: 2.1 time: 0.030842 Oct 18 11:55:37.992485 dv-cinder-815582-17-iscsi devstack@n-api.service[125485]: [pid: 125485|app: 0|req: 523/1010] 10.222.0.17 () {58 vars in 1263 bytes} [Tue Oct 18 11:55:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1505591231 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 11:56:09.225561 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 11:56:09.226036 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Tue Oct 18 11:56:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.17) !!! Oct 18 11:56:09.227763 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 11:56:09.227884 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Tue Oct 18 11:56:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.17) !!! Oct 18 11:56:09.229422 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 11:56:09.229576 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Tue Oct 18 11:56:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.17) !!! Oct 18 11:59:29.243745 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 11:59:29.244330 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Tue Oct 18 11:59:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.17) !!! Oct 18 11:59:29.245005 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 11:59:29.245113 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Tue Oct 18 11:59:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.17) !!! Oct 18 11:59:29.246823 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 11:59:29.246943 dv-cinder-815582-17-iscsi devstack@n-api.service[125486]: Tue Oct 18 11:59:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.17) !!!